-- Logs begin at Sun 2022-07-31 13:20:19 UTC, end at Sun 2022-07-31 14:43:18 UTC. -- Jul 31 14:13:13.758317 dv-cinder-849846-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 31 14:13:13.765814 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 31 14:13:13.768943 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jul 31 14:13:13 2022] *** Jul 31 14:13:13.768943 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 31 14:13:13.768943 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 31 14:13:13.768943 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: nodename: dv-cinder-849846-4-iscsi Jul 31 14:13:13.768943 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: machine: x86_64 Jul 31 14:13:13.768943 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: clock source: unix Jul 31 14:13:13.768943 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: pcre jit disabled Jul 31 14:13:13.768943 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: detected number of CPU cores: 4 Jul 31 14:13:13.768943 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: current working directory: / Jul 31 14:13:13.768943 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: detected binary path: /usr/bin/uwsgi-core Jul 31 14:13:13.768943 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: your processes number limit is 47680 Jul 31 14:13:13.769635 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: your memory page size is 4096 bytes Jul 31 14:13:13.769635 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: detected max file descriptor number: 2048 Jul 31 14:13:13.769635 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: lock engine: pthread robust mutexes Jul 31 14:13:13.769635 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: thunder lock: enabled Jul 31 14:13:13.769635 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 31 14:13:13.769635 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 31 14:13:13.808730 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: Python main interpreter initialized at 0x55a11b1089c0 Jul 31 14:13:13.808730 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: python threads support enabled Jul 31 14:13:13.808730 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: your server socket listen backlog is limited to 100 connections Jul 31 14:13:13.808730 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: your mercy for graceful operations on workers is 90 seconds Jul 31 14:13:13.809100 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: mapped 403077 bytes (393 KB) for 2 cores Jul 31 14:13:13.809178 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: *** Operational MODE: preforking *** Jul 31 14:13:13.809390 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: *** uWSGI is running in multiple interpreter mode *** Jul 31 14:13:13.809390 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: spawned uWSGI master process (pid: 103131) Jul 31 14:13:13.809584 dv-cinder-849846-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 31 14:13:13.810147 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: spawned uWSGI worker 1 (pid: 103132, cores: 1) Jul 31 14:13:13.811788 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: spawned uWSGI worker 2 (pid: 103133, cores: 1) Jul 31 14:13:13.811788 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 31 14:13:14.478265 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 31 14:13:14.481120 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 31 14:13:15.566159 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 14:13:15.566159 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: from cryptography.utils import int_from_bytes Jul 31 14:13:15.566854 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 14:13:15.566854 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: from cryptography.utils import int_from_bytes Jul 31 14:13:15.567304 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 14:13:15.567304 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: from cryptography.utils import int_from_bytes Jul 31 14:13:15.567752 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 14:13:15.567752 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: from cryptography.utils import int_from_bytes Jul 31 14:13:18.052305 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 14:13:18.052861 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 14:13:18.053244 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 14:13:18.053332 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 14:13:18.053410 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 14:13:18.053495 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 14:13:18.053587 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 14:13:18.053675 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 14:13:18.053753 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 14:13:18.053844 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 14:13:18.054056 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.054232 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.054945 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.055108 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.055266 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.055469 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.055605 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.055918 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.056030 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.056248 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.056336 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.056563 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.056657 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.056884 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.056975 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.057204 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.057319 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.057468 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.057563 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.057790 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.057888 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.058106 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.058191 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-4-iscsi {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.058432 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.058518 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-4-iscsi {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.058745 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.058829 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.059059 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.059142 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.059373 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.059489 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.059710 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.059794 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.060018 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.060104 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.060332 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.060417 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.060641 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.060830 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.061226 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.061380 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.061489 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.061599 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.061743 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.061866 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.062058 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.062236 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.062396 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.062526 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.062718 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.062812 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.063031 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.063115 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.063356 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.063490 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.063699 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.063782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.064028 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.064137 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.064342 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.064434 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-4-iscsi {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.064738 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-4-iscsi {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.064827 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.065060 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.065180 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.065636 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.065782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.065956 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.066089 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.066350 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.066448 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.066664 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.066750 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.066976 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.067070 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.067302 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.067387 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.067646 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.067790 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.067960 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.068054 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.068291 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.068382 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.068614 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.068707 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.068936 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.069029 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.069245 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.069331 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.069560 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.069652 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.069895 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.069987 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.070213 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.070297 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.070524 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.070609 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.070835 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.070980 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.071093 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.071177 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.071405 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.071566 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.071727 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.071825 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.072053 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.072140 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.072378 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.072489 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.072640 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.072753 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.072896 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.072983 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.073185 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.073277 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.073507 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.073612 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.073828 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.073917 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.074138 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.074223 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.074447 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.074531 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.074755 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.074838 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.075065 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.075163 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.075375 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.075505 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.075710 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.075795 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.076019 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.076104 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.076331 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.076414 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.076648 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.076740 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.076963 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.077046 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.077275 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.077365 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.077587 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.077677 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.077911 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.078009 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.078225 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.078309 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.078540 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.078633 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.078852 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.078942 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.079194 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.079286 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.079537 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.079640 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.079851 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.079942 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.080175 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.080264 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.080487 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.080571 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.080798 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.080889 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.081109 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.081196 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.081419 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.081505 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.081742 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.081825 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.082054 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.082136 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.082293 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.082375 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.082601 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.082685 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.082902 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.082988 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.083213 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.083310 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.083557 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.083643 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.083867 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.083959 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.084175 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.084266 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.084481 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.084570 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.084784 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.084875 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.085094 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.085177 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.085405 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.085515 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.085741 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.085838 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.086048 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.086133 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.086354 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.086438 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.086659 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.086752 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.086967 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.087059 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.087274 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.087366 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.087607 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.087709 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.087930 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.088070 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.088241 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.088326 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.088547 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.088633 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.088856 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.088940 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.089164 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.089257 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.089471 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.089566 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.089787 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.089871 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.090094 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.090177 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.090405 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.090503 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.090714 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.090805 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.091024 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.091109 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.091334 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.091469 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.091677 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.091761 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.091988 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.092071 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.092302 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.092395 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.092608 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.092699 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.092920 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.093017 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.093229 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.093316 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.093539 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.093625 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.093850 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.093933 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.094160 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.094254 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.094468 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.094561 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.094775 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.094867 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.095080 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.095165 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.095387 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.095538 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.095718 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.095815 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.096025 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.096111 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.096326 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.096417 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.096646 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.096746 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.096962 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.097055 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.097274 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.097357 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.097584 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.097676 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.097893 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.097983 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.098217 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:13:18.098309 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.098559 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.098663 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.098896 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.098989 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.099215 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.099299 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.099580 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.099670 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.099920 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.100014 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.100250 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.100335 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.100572 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.100658 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.100891 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.100976 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.101729 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.101823 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.102050 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.102136 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.102370 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.102453 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.102686 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.102783 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.103007 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.103104 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.103326 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.103411 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.103674 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.103778 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.104002 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.104089 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.104322 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.104415 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.104643 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.104728 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.104962 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.105050 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.105277 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.105368 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.105601 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.105696 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.105924 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.106010 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.106241 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.106327 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.106553 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.106650 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.106898 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.106984 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.107228 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.107312 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.107580 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.107682 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.107909 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.108004 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.108228 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.108322 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.108545 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.108639 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.108860 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.108952 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.109175 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.109259 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.109510 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.109597 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.109826 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.109911 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.110150 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.110236 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.110469 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.110564 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.110784 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.110870 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.111098 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.111182 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.111409 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.111545 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.111747 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.111843 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.112065 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.112151 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.112403 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.112494 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.112721 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.112804 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.113039 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.113164 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.113351 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.113457 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.113701 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.113807 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.113973 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.114075 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.114284 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.114377 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.114594 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.114696 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.114898 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.114999 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.115205 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.115305 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.115535 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.115640 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.115843 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.115952 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.116149 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.116240 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.116475 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.116574 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.116850 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.117531 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.117706 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.117843 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.118020 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.118150 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.118340 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.118486 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.118662 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.118800 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.118979 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.119108 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.119293 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.119447 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.119637 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.119721 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.119952 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.120034 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.120265 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.120352 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.120575 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.120669 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.120901 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.120996 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.121214 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.121301 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.121523 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.121607 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.121847 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.121947 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.122157 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.122269 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.125068 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.125221 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.125221 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.125437 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.125543 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.125655 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.125758 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.125859 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.125960 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.126084 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.126084 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.126296 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.126296 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.126496 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.126607 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.126710 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.126710 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.126896 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.126997 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.127097 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.127097 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.127305 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.127305 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.127532 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.127625 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.127704 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.127788 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.127914 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.127914 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.128102 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.128179 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.128254 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.128384 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.128506 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.128506 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.128658 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.128741 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.128826 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.128910 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.128987 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.129069 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.129145 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.129222 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.129305 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.129384 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.129459 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.129534 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.129615 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.129833 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.129926 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.130134 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.130217 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.130456 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.130540 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.130767 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.130863 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.131074 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.131164 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.131384 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.131542 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.131717 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.131822 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.132066 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.132154 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.132401 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.132488 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.132752 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.132842 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.133090 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.133175 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.133415 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.133512 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.133732 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.133822 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.134051 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.134139 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.134366 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.134461 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.134682 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.134769 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.134996 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.135090 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.135308 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.135402 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.135652 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.135748 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.135968 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.136053 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.136286 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.136379 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.136600 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.136686 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.136913 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.136998 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.137234 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.137327 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.137552 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.137658 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.137858 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.137943 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.138175 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.138287 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.138898 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.139080 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.139080 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.139371 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.139546 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.139706 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.139853 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.139996 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.140137 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.140279 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.140442 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.140587 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.140728 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.140872 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.141014 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.141164 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.141315 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.141471 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.141614 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.141756 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.141905 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.142049 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.142200 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.142354 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.142496 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.142637 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.142778 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.142921 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.143071 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.143674 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.143759 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.143837 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.143915 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.144012 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.144145 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.144237 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.144326 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.144414 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.144501 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.144582 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.144721 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.144808 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.145039 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.145125 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.145357 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.145444 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.145678 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.145763 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.145993 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.146079 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.146306 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.146392 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.146621 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.146713 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.146933 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.147026 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.147243 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.147329 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.147585 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.147753 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.147900 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.147998 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.148241 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.148327 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.148556 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.148663 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.148869 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.148975 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.149177 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.149272 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.149489 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.149573 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.149799 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.149892 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.150109 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.150194 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.150421 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.150512 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.150739 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.150831 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.151053 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.151136 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.151372 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.151500 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.151726 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.151820 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.152035 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.152119 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.152347 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.152431 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.152656 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.152748 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.152977 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.153057 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.153290 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.153376 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.153598 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.153683 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.153905 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.153995 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.154216 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.154319 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.154559 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.154652 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.154870 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.154954 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.155179 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.155261 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.155530 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.155630 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.155848 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.155939 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.156167 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.156259 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.156483 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.156567 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.156798 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.156882 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.157118 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.157216 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.157434 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.157531 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.157753 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.157846 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.158067 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.158159 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.158382 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.158465 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.158696 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.158778 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.159012 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.159121 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.159326 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.159409 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.159678 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.159764 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.159995 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.160080 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.160310 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.160394 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.160623 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.160708 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.160934 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.161019 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.161254 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.161340 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.161580 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.161840 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.162158 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.162244 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.162490 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.162573 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.162815 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.162900 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.163143 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.163244 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.163487 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.163574 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.164330 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.164438 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.164664 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.164748 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.164999 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.165081 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.165311 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.165408 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.165629 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.165733 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.165941 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.166035 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.166251 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.166336 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.166564 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.166648 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.166873 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.166959 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.167183 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.167269 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.167514 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.167613 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.167832 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.168150 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.168463 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.168775 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.169092 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.169404 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.169570 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.169725 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.169893 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.170043 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.170213 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.170362 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.170532 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.170673 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.170849 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.171003 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.171173 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.171320 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.171522 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.171662 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.171845 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.171972 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.172157 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.172282 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.172490 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.172629 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.172807 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.172941 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.173120 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.173285 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.173437 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.173622 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.173748 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.173974 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.174097 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.174288 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.174410 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.174602 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.174754 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.174933 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.175089 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.175245 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.175454 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.175582 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.175775 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.175881 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.176088 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.176197 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.176421 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.176507 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.176734 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.176826 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.177046 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.177130 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.177357 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.177441 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.177674 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.177771 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.177990 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.178076 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.178300 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.178384 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.178617 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.178714 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.178930 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.179023 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.179266 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.179881 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.180131 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.180217 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.180444 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.180528 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.180754 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.180837 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.181072 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.181158 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.181388 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.181482 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.181698 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.181783 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.182005 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.182090 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.182311 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.182401 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.182624 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.182716 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.182930 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.183019 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.183236 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.183318 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.183574 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.183676 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.183882 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.183967 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.184192 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.184282 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.184501 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.184598 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.184812 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.184904 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.185121 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.185205 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.185435 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.185532 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.185744 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.185829 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.186050 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.186132 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.186356 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.186441 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.186664 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.186748 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.186972 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.187061 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.187281 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.187374 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.187621 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.187709 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.187928 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.188012 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.188236 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.188324 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.188543 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.188625 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.188854 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.188946 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.189164 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.189265 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.189470 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.189574 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.189773 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.189866 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.190080 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.190165 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.190648 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.190737 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.190957 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.191048 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.191277 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.191372 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.191594 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.191679 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.191905 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.192001 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.192213 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.192298 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.192519 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.192602 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.192827 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.192920 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.193152 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.193244 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.193473 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.193556 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.193779 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.193864 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.194089 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.194175 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.194397 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.194487 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.194749 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.194836 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.195090 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.195177 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.195408 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.195535 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.195750 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.195837 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.196062 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.196148 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.196385 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.196476 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.196700 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.196785 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.197016 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.197099 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.197328 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.197415 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.197636 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.197721 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.197958 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.198050 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.198274 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.198369 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.198589 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.198674 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.198900 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.198987 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.199212 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.199305 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.199568 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.199667 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.199876 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.199959 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.200192 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.200289 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.200508 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.200594 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.200826 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.200909 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.201142 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.201236 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.201457 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.201542 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.201771 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.201856 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.202085 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.202170 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.202399 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.202482 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.202712 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.202800 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.203027 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.203112 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.203337 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.203464 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.203678 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.203766 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.203995 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.204080 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.204303 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.204386 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.204620 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.204703 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.204935 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.205025 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.205244 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.205327 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.205559 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.205650 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.205868 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.205953 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.206187 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.206270 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.206497 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.206595 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.206807 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.206935 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.207125 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.207257 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.207458 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.207602 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.207782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.207915 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.208095 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.208232 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.208529 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.208625 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.208851 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.208943 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.209168 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.209251 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.209478 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.209584 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.209799 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.209896 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.210116 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.210201 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.210439 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.211023 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.211285 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.211369 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.211625 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.211729 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.211960 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.212046 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.212280 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.212371 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.212612 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.212698 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.212925 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.213011 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.213236 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.213321 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.213548 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.213639 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.213867 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.213956 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.214176 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.214259 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.214494 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.214593 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.214807 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.214930 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.215119 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.215206 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.215466 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.215568 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.215783 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.215949 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.216112 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.216271 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.216533 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.216630 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.216854 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.216939 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.217167 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.217258 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.217538 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.217623 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.217852 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.217938 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.218178 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.218269 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.218497 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.218583 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.218827 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.218921 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.219154 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.219252 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.219488 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.219575 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.219817 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.219938 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.220128 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.220227 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.220457 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.220556 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.220789 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.220894 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.221106 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.221201 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.221430 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.221527 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.221745 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.221842 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.222076 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.222182 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.222407 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.222513 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.222730 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.222826 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.223065 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.223160 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.223389 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.223521 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.223730 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.223825 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.224049 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.224145 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.224360 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.224465 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.224671 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.224779 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.224999 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.225100 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.225311 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.225410 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.225631 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.225724 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.225947 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.226032 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.226812 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.226912 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.227127 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.227213 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.227463 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.227552 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.227789 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.227877 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.228100 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.228184 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.228428 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.228518 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.228744 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.228847 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.229055 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.229141 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.229380 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.229465 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.229689 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.229775 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.230016 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.230112 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.230334 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.230463 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.230653 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.230744 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.230963 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.231048 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.231273 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.231366 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.231626 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.231712 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.231948 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.232034 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.232261 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.232422 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.232573 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.232660 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.232891 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.232976 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.233221 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.233313 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.233538 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.233629 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.233865 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.233960 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.234191 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.234277 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.234518 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.234603 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.234832 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.234915 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.235149 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.235258 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.235479 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.235568 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.235798 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.235885 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.236113 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.236200 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.236426 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.236511 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.236737 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.236820 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.237043 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.237134 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.237351 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.237443 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.237658 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.237821 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.237965 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.238049 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.238271 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.238357 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.238636 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.238746 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.238892 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.238978 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.239202 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.239294 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.239530 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.239631 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.239846 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.239939 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.240155 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.240252 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.240481 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.240580 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.240796 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.240882 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.241104 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.241188 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.241414 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.241502 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.241724 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.241811 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.242093 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.242177 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.242405 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.242492 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.242732 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.242815 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.243057 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.243142 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.243379 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.243496 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.243726 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.243876 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.244045 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.244130 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.244363 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.244450 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.244686 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.244776 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.245005 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.245170 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.245322 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.245409 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.245643 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.245727 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.245961 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.246052 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.246280 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.246365 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.246602 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.246806 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.246916 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.247144 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.247238 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.247489 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.247580 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.247815 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.247899 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.248137 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.248390 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.248476 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.248731 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.248848 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.249055 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.249155 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.249370 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.249465 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.249687 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.249784 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.250000 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.250096 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.250318 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.250412 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.250638 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.250735 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.250957 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.251063 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.251277 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.251373 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.251622 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.251732 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.251941 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.252036 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.252264 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.252360 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.252587 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.252691 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.252928 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.253024 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.253252 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.253358 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.253563 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.253658 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.253881 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.253979 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.254200 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.254294 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.254522 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.254618 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.254840 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.254936 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.255158 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.255282 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.255497 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.255595 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.255820 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.255916 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.256137 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.256233 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.256453 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.256538 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.256769 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.256864 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.257088 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.257188 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.257433 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.257524 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.257755 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.257851 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.258071 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.258166 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.258390 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.258477 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.258705 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.258790 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.259029 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.259124 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.259366 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.259579 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.259723 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.259898 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.260043 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.260239 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.260396 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.260576 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.260709 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.260907 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.261201 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.261339 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.261527 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.261663 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.261855 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.261997 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.262168 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.262301 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.262480 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.262608 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.262797 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.262944 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.263112 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.263254 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.263450 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.263585 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.263767 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.263912 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.264080 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.264215 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.264390 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.264520 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.264703 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.264844 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.265015 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.265157 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.265341 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.265533 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.265659 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.265885 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.265977 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.266209 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.266294 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.266542 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.266636 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.266874 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.267104 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.267189 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.267479 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.267571 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.267805 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.267900 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.268134 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.268218 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.268447 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.268533 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.268770 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.268857 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.269083 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.269179 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.269390 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.269502 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.269707 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.269805 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.270014 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.270100 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.270327 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.270477 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.270642 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.270728 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.270957 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.271040 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.271266 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.271358 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.271612 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.271701 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.271921 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.272008 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.272234 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.272326 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.272546 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.272644 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.272856 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.272947 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.273683 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.273769 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.273996 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.274088 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.274307 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.274390 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.274614 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.274699 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.274930 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.275014 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.275237 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.275359 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.275566 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.275678 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.275870 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.275966 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.276182 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.276269 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.276491 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.276577 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.276800 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.276883 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.277117 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.277216 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.277429 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.277515 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.277746 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.277832 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.278053 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.278145 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.278366 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.278450 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.278679 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.278769 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.279008 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.279115 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.279329 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.279448 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.279663 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.279802 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.279986 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.280085 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.280306 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.280391 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.280635 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.280842 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.280940 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.281191 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.281276 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.281518 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.281609 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.281856 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.281949 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.282194 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.282437 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.282528 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.282780 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.282865 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.283100 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.283186 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.283451 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.283539 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.283769 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.283865 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.284086 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.284173 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.284399 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.284490 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.284714 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.284807 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.285026 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.285110 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.285341 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.285425 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.285657 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.285751 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.285973 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.286057 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.286282 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.286367 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.286596 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.286688 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.286909 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.287000 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.287222 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.287306 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.287555 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.287654 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.287871 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.287956 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.288184 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.288279 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.288501 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.288589 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.289379 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.289590 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.289684 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.289930 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.290049 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.290258 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.290347 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.290601 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.290688 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.290912 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.291009 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.291235 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.291322 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.291576 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.291667 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.291897 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.291987 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.292221 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.292307 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.292541 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.292635 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.292860 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.292949 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.293170 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.293255 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.293490 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.293583 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.293830 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.293918 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.294178 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.294273 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.294463 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.294558 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.294822 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.294909 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.295152 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.295239 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.295501 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.295605 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.295822 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.295923 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.296153 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.296239 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.296476 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.296565 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.296803 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.296890 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.297123 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.297209 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.297452 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.297540 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.297772 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.297858 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.298083 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.298169 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.298397 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.298485 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.298708 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.298796 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.299023 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.299118 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.299346 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.299457 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.299689 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.299785 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.300001 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.300113 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.300309 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.300397 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.300625 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.300713 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.300938 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.301041 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.301245 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.301331 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.301552 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.301636 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.301860 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.301961 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.302171 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.302257 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.302518 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.302611 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.302782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.302876 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.303085 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.303170 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.303391 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.303507 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.303724 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.303812 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.304032 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.304124 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.304369 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.304465 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.304675 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.304763 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.304984 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.305076 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.305289 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.305374 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.305596 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.305693 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.305906 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.306004 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.306217 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.306314 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.306527 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.306615 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.306838 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.306931 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.307150 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.307246 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.307509 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.307600 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.307836 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.307921 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.308153 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.308253 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.308481 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.308569 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.308796 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.308881 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.309114 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.309213 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.309429 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.309515 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.309758 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.309853 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.310074 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.310187 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.310391 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.310489 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.310705 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.310789 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.311024 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.311129 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.311337 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.311483 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.311682 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.311768 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.312002 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.312096 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.312321 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.312415 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.312634 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.312719 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.312950 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.313048 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.313277 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.313361 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.313602 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.313696 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.313913 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.314004 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.314232 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.314324 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.314557 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.314651 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.314873 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.314958 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.315193 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.315277 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.315804 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.315910 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.316123 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.316209 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.316441 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.316528 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.316756 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.316842 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.317071 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.317155 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.317385 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.317475 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.317703 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.317795 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.318023 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.318108 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.318341 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.318427 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.318658 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.318744 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.318976 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.319060 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.319296 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.319392 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.319657 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.319777 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.320018 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.320117 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.320336 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.320438 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.320668 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.320754 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.321000 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.321137 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.321335 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.321428 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.321654 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.321741 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.321967 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.322060 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.322197 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 14:13:18.322327 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.322650 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.322969 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.323284 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:13:18.323558 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 14:13:18.478263 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO dbcounter [None req-68dc1fd5-7837-407b-b194-2c29a6bf0d58 None None] Registered counter for database nova_api Jul 31 14:13:18.481150 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO dbcounter [None req-fa117931-ede5-450f-9b12-73590e89ec22 None None] Registered counter for database nova_api Jul 31 14:13:18.498268 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG oslo_db.sqlalchemy.engines [None req-68dc1fd5-7837-407b-b194-2c29a6bf0d58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 14:13:18.500590 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_db.sqlalchemy.engines [None req-fa117931-ede5-450f-9b12-73590e89ec22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 14:13:18.504898 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writer thread running {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 14:13:18.507027 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG dbcounter [-] [103132] Writer thread running {{(pid=103132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 14:13:18.560724 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.context [None req-68dc1fd5-7837-407b-b194-2c29a6bf0d58 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),75a43629-b1b3-47e1-9ca8-733d69d3b5de(cell1) {{(pid=103133) load_cells /opt/stack/nova/nova/context.py:464}} Jul 31 14:13:18.562207 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.context [None req-fa117931-ede5-450f-9b12-73590e89ec22 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),75a43629-b1b3-47e1-9ca8-733d69d3b5de(cell1) {{(pid=103132) load_cells /opt/stack/nova/nova/context.py:464}} Jul 31 14:13:18.564711 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-68dc1fd5-7837-407b-b194-2c29a6bf0d58 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:13:18.566415 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_concurrency.lockutils [None req-fa117931-ede5-450f-9b12-73590e89ec22 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:13:18.566593 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-68dc1fd5-7837-407b-b194-2c29a6bf0d58 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:13:18.567395 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-68dc1fd5-7837-407b-b194-2c29a6bf0d58 None None] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:13:18.568056 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_concurrency.lockutils [None req-fa117931-ede5-450f-9b12-73590e89ec22 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:13:18.568853 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_concurrency.lockutils [None req-fa117931-ede5-450f-9b12-73590e89ec22 None None] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:13:18.569392 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG oslo_concurrency.lockutils [None req-68dc1fd5-7837-407b-b194-2c29a6bf0d58 None None] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:13:18.571353 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_concurrency.lockutils [None req-fa117931-ede5-450f-9b12-73590e89ec22 None None] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:13:18.571889 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO dbcounter [None req-68dc1fd5-7837-407b-b194-2c29a6bf0d58 None None] Registered counter for database nova_cell0 Jul 31 14:13:18.573345 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO dbcounter [None req-fa117931-ede5-450f-9b12-73590e89ec22 None None] Registered counter for database nova_cell0 Jul 31 14:13:18.577258 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO dbcounter [None req-68dc1fd5-7837-407b-b194-2c29a6bf0d58 None None] Registered counter for database nova_cell1 Jul 31 14:13:18.578675 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO dbcounter [None req-fa117931-ede5-450f-9b12-73590e89ec22 None None] Registered counter for database nova_cell1 Jul 31 14:13:18.584445 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG oslo_db.sqlalchemy.engines [None req-68dc1fd5-7837-407b-b194-2c29a6bf0d58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 14:13:18.588540 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_db.sqlalchemy.engines [None req-fa117931-ede5-450f-9b12-73590e89ec22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 14:13:18.591071 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writer thread running {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 14:13:18.591771 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG oslo_db.sqlalchemy.engines [None req-68dc1fd5-7837-407b-b194-2c29a6bf0d58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 14:13:18.592435 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_db.sqlalchemy.engines [None req-fa117931-ede5-450f-9b12-73590e89ec22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 14:13:18.595387 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG dbcounter [-] [103132] Writer thread running {{(pid=103132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 14:13:18.730148 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writer thread running {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 14:13:18.732981 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG dbcounter [-] [103132] Writer thread running {{(pid=103132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 14:13:18.738806 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO dbcounter [None req-68dc1fd5-7837-407b-b194-2c29a6bf0d58 None None] Registered counter for database nova_cell0 Jul 31 14:13:18.742887 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO dbcounter [None req-fa117931-ede5-450f-9b12-73590e89ec22 None None] Registered counter for database nova_cell0 Jul 31 14:13:18.745532 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG oslo_db.sqlalchemy.engines [None req-68dc1fd5-7837-407b-b194-2c29a6bf0d58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 14:13:18.750163 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writer thread running {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 14:13:18.751564 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_db.sqlalchemy.engines [None req-fa117931-ede5-450f-9b12-73590e89ec22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 14:13:18.756198 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG dbcounter [-] [103132] Writer thread running {{(pid=103132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 14:13:19.085398 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: WARNING keystonemiddleware.auth_token [None req-68dc1fd5-7837-407b-b194-2c29a6bf0d58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 14:13:19.088722 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: WARNING keystonemiddleware.auth_token [None req-fa117931-ede5-450f-9b12-73590e89ec22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 14:13:19.092595 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: WARNING keystonemiddleware.auth_token [None req-68dc1fd5-7837-407b-b194-2c29a6bf0d58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 14:13:19.095924 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: WARNING keystonemiddleware.auth_token [None req-fa117931-ede5-450f-9b12-73590e89ec22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 14:13:19.438165 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: WARNING keystonemiddleware.auth_token [None req-fa117931-ede5-450f-9b12-73590e89ec22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 14:13:19.444485 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: WARNING keystonemiddleware.auth_token [None req-fa117931-ede5-450f-9b12-73590e89ec22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 14:13:19.449784 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a11b1089c0 pid: 103132 (default app) Jul 31 14:13:19.451463 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: WARNING keystonemiddleware.auth_token [None req-68dc1fd5-7837-407b-b194-2c29a6bf0d58 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 14:13:19.451896 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-fa117931-ede5-450f-9b12-73590e89ec22 None None] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:13:19.453089 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-fa117931-ede5-450f-9b12-73590e89ec22 None None] 10.222.0.40 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001768 Jul 31 14:13:19.453513 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 788 bytes} [Sun Jul 31 14:13:19 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:13:19.459786 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: WARNING keystonemiddleware.auth_token [None req-68dc1fd5-7837-407b-b194-2c29a6bf0d58 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 14:13:19.466399 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a11b1089c0 pid: 103133 (default app) Jul 31 14:14:34.992144 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-fa117931-ede5-450f-9b12-73590e89ec22 None None] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:14:34.993160 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-fa117931-ede5-450f-9b12-73590e89ec22 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 Jul 31 14:14:34.993745 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 930 bytes} [Sun Jul 31 14:14:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:14:35.005819 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writing DB stats nova_api:SELECT=3 {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:14:35.006923 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writing DB stats nova_cell1:SELECT=3 {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:14:35.008143 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writing DB stats nova_cell0:SELECT=3 {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:14:35.009011 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:14:35.907010 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-95eb18f3-6ec3-405b-8628-9c6b7c48c648 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:14:35.942547 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-95eb18f3-6ec3-405b-8628-9c6b7c48c648 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.942117 Jul 31 14:14:35.943507 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 1/3] 10.222.0.40 () {60 vars in 1291 bytes} [Sun Jul 31 14:14:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:14:38.164051 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-fa117931-ede5-450f-9b12-73590e89ec22 None None] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:14:38.165160 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-fa117931-ede5-450f-9b12-73590e89ec22 None None] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Jul 31 14:14:38.165740 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 3/4] 10.222.0.40 () {54 vars in 930 bytes} [Sun Jul 31 14:14:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:14:38.600758 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-2ad4c2d0-215a-4e0c-9978-3b4867482ea8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:14:38.621495 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 14:14:38.621495 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: warnings.warn(msg) Jul 31 14:14:38.654162 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-2ad4c2d0-215a-4e0c-9978-3b4867482ea8 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.481914 Jul 31 14:14:38.662939 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 2/5] 10.222.0.40 () {64 vars in 1282 bytes} [Sun Jul 31 14:14:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 14:14:38.669246 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG dbcounter [-] [103132] Writing DB stats nova_api:SELECT=3 {{(pid=103132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:14:38.670531 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG dbcounter [-] [103132] Writing DB stats nova_cell1:SELECT=3 {{(pid=103132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:14:38.671649 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG dbcounter [-] [103132] Writing DB stats nova_cell0:SELECT=3 {{(pid=103132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:14:38.672474 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG dbcounter [-] [103132] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:14:38.875960 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-33f4e0c8-711d-4fdf-b7c6-767ca14be33d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:14:38.882063 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 14:14:38.882063 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: warnings.warn(msg) Jul 31 14:14:38.948516 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-33f4e0c8-711d-4fdf-b7c6-767ca14be33d admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284457 Jul 31 14:14:38.949405 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 4/6] 10.222.0.40 () {64 vars in 1335 bytes} [Sun Jul 31 14:14:38 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:14:41.168069 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-2ad4c2d0-215a-4e0c-9978-3b4867482ea8 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:14:41.169165 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-2ad4c2d0-215a-4e0c-9978-3b4867482ea8 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001712 Jul 31 14:14:41.169741 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 3/7] 10.222.0.40 () {54 vars in 930 bytes} [Sun Jul 31 14:14:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:14:41.820673 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-cb7be159-5ca2-4189-8202-0c6995604aa5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "rxtx_factor": 1.0, "id": "d1", "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M"}} {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:14:41.840128 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 14:14:41.840128 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: warnings.warn(msg) Jul 31 14:14:41.860354 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-cb7be159-5ca2-4189-8202-0c6995604aa5 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.684370 Jul 31 14:14:41.861174 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 5/8] 10.222.0.40 () {64 vars in 1282 bytes} [Sun Jul 31 14:14:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 14:14:41.874173 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-20fb0ae1-e616-4c54-8236-eead5b5165da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:14:41.877237 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 14:14:41.877237 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: warnings.warn(msg) Jul 31 14:14:41.912288 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-20fb0ae1-e616-4c54-8236-eead5b5165da admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041787 Jul 31 14:14:41.915555 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 4/9] 10.222.0.40 () {64 vars in 1335 bytes} [Sun Jul 31 14:14:41 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:14:44.119667 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-cb7be159-5ca2-4189-8202-0c6995604aa5 admin admin] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:14:44.120689 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-cb7be159-5ca2-4189-8202-0c6995604aa5 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 31 14:14:44.121660 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 930 bytes} [Sun Jul 31 14:14:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:14:44.493180 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-8eb03b74-34ff-4a99-b947-e11787332ee9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "ds1G", "id": "d2", "disk": 10}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:14:44.512924 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-8eb03b74-34ff-4a99-b947-e11787332ee9 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.385326 Jul 31 14:14:44.513516 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 5/11] 10.222.0.40 () {64 vars in 1282 bytes} [Sun Jul 31 14:14:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 14:14:44.525335 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-c2b818fc-0703-4364-b13c-5ee407dd370c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:14:44.548770 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-c2b818fc-0703-4364-b13c-5ee407dd370c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027106 Jul 31 14:14:44.549337 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 7/12] 10.222.0.40 () {64 vars in 1335 bytes} [Sun Jul 31 14:14:44 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:14:46.793744 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-8eb03b74-34ff-4a99-b947-e11787332ee9 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:14:46.794792 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-8eb03b74-34ff-4a99-b947-e11787332ee9 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 31 14:14:46.795195 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 6/13] 10.222.0.40 () {54 vars in 930 bytes} [Sun Jul 31 14:14:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:14:47.240412 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-8c36a56a-fc6b-4802-b8e7-5aacabb2f57c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 2, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G", "rxtx_factor": 1.0}} {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:14:47.259723 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-8c36a56a-fc6b-4802-b8e7-5aacabb2f57c admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.458396 Jul 31 14:14:47.260275 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 8/14] 10.222.0.40 () {64 vars in 1282 bytes} [Sun Jul 31 14:14:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 14:14:47.273237 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-916e700f-dde6-45cf-ba5e-745639b081b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:14:47.297368 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-916e700f-dde6-45cf-ba5e-745639b081b8 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028434 Jul 31 14:14:47.297994 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 7/15] 10.222.0.40 () {64 vars in 1335 bytes} [Sun Jul 31 14:14:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:14:49.519530 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-8c36a56a-fc6b-4802-b8e7-5aacabb2f57c admin admin] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:14:49.520534 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-8c36a56a-fc6b-4802-b8e7-5aacabb2f57c admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002099 Jul 31 14:14:49.520934 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 9/16] 10.222.0.40 () {54 vars in 930 bytes} [Sun Jul 31 14:14:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:14:49.932031 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-df24e2ed-4dc0-4d2f-9608-7c7a219fea49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds4G", "ram": 4096, "id": "d4"}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:14:49.951688 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-df24e2ed-4dc0-4d2f-9608-7c7a219fea49 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.424865 Jul 31 14:14:49.952332 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 8/17] 10.222.0.40 () {64 vars in 1282 bytes} [Sun Jul 31 14:14:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 14:14:49.963850 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-82e24317-8e26-4c94-a1f1-445feba3da6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:14:49.989361 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-82e24317-8e26-4c94-a1f1-445feba3da6a admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029120 Jul 31 14:14:49.990935 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 10/18] 10.222.0.40 () {64 vars in 1335 bytes} [Sun Jul 31 14:14:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:14:52.224670 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-df24e2ed-4dc0-4d2f-9608-7c7a219fea49 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:14:52.225725 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-df24e2ed-4dc0-4d2f-9608-7c7a219fea49 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 31 14:14:52.226135 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 9/19] 10.222.0.40 () {54 vars in 930 bytes} [Sun Jul 31 14:14:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:14:52.644392 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-178cc773-d9c6-4672-be8c-f2cf399bdaeb admin admin] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:14:52.668707 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-178cc773-d9c6-4672-be8c-f2cf399bdaeb admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.436425 Jul 31 14:14:52.669249 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 11/20] 10.222.0.40 () {60 vars in 1291 bytes} [Sun Jul 31 14:14:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:14:54.844502 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-df24e2ed-4dc0-4d2f-9608-7c7a219fea49 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:14:54.845860 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-df24e2ed-4dc0-4d2f-9608-7c7a219fea49 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002056 Jul 31 14:14:54.846852 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 10/21] 10.222.0.40 () {54 vars in 930 bytes} [Sun Jul 31 14:14:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:14:55.308477 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-2fb5e64f-14da-4c79-921f-2f536cdd8e95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "ram": 512}} {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:14:55.326935 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-2fb5e64f-14da-4c79-921f-2f536cdd8e95 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.474005 Jul 31 14:14:55.327502 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 12/22] 10.222.0.40 () {64 vars in 1282 bytes} [Sun Jul 31 14:14:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 14:14:55.339197 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-652c8844-4732-47c6-8a66-14d3116fc266 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:14:55.363381 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-652c8844-4732-47c6-8a66-14d3116fc266 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027735 Jul 31 14:14:55.363974 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 11/23] 10.222.0.40 () {64 vars in 1332 bytes} [Sun Jul 31 14:14:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:14:57.540973 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-2fb5e64f-14da-4c79-921f-2f536cdd8e95 admin admin] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:14:57.542022 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-2fb5e64f-14da-4c79-921f-2f536cdd8e95 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 31 14:14:57.542425 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 930 bytes} [Sun Jul 31 14:14:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:14:57.927841 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-9721be9c-e8d1-4775-a6df-b530f1de2970 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "name": "m1.small", "disk": 20, "vcpus": 1}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:14:57.948446 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-9721be9c-e8d1-4775-a6df-b530f1de2970 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.400227 Jul 31 14:14:57.949140 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 12/25] 10.222.0.40 () {64 vars in 1282 bytes} [Sun Jul 31 14:14:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 14:14:57.960742 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-2e54f7e6-07ba-449f-a584-7129bc0d904b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:14:57.985584 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-2e54f7e6-07ba-449f-a584-7129bc0d904b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028419 Jul 31 14:14:57.986153 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 14/26] 10.222.0.40 () {64 vars in 1332 bytes} [Sun Jul 31 14:14:57 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:15:00.183903 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-9721be9c-e8d1-4775-a6df-b530f1de2970 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:00.184947 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-9721be9c-e8d1-4775-a6df-b530f1de2970 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jul 31 14:15:00.185509 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 13/27] 10.222.0.40 () {54 vars in 930 bytes} [Sun Jul 31 14:15:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:15:00.592877 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-85ddcf30-bbf0-44a8-b07e-1a1884f34c27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "m1.medium", "disk": 40, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "id": "3"}} {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:15:00.611132 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-85ddcf30-bbf0-44a8-b07e-1a1884f34c27 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.419774 Jul 31 14:15:00.618675 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 15/28] 10.222.0.40 () {64 vars in 1282 bytes} [Sun Jul 31 14:15:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 14:15:00.624185 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-af930dd8-7095-4a69-96ab-89925aa86800 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:15:00.653457 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-af930dd8-7095-4a69-96ab-89925aa86800 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033116 Jul 31 14:15:00.653950 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 14/29] 10.222.0.40 () {64 vars in 1332 bytes} [Sun Jul 31 14:15:00 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:15:02.999481 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-85ddcf30-bbf0-44a8-b07e-1a1884f34c27 admin admin] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:02.999481 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-85ddcf30-bbf0-44a8-b07e-1a1884f34c27 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jul 31 14:15:03.007530 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 16/30] 10.222.0.40 () {54 vars in 930 bytes} [Sun Jul 31 14:15:02 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:15:03.455944 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-81b1ff9c-b06c-42e9-b706-dd361abf4acd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "name": "m1.large", "swap": 0}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:15:03.476148 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-81b1ff9c-b06c-42e9-b706-dd361abf4acd admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.470527 Jul 31 14:15:03.483808 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 15/31] 10.222.0.40 () {64 vars in 1282 bytes} [Sun Jul 31 14:15:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 14:15:03.489006 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-7c1346fe-e440-4728-8bab-aabf5b935697 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:15:03.514986 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-7c1346fe-e440-4728-8bab-aabf5b935697 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029559 Jul 31 14:15:03.515684 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 17/32] 10.222.0.40 () {64 vars in 1332 bytes} [Sun Jul 31 14:15:03 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:15:05.724908 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-81b1ff9c-b06c-42e9-b706-dd361abf4acd admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:05.725932 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-81b1ff9c-b06c-42e9-b706-dd361abf4acd admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jul 31 14:15:05.726329 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 16/33] 10.222.0.40 () {54 vars in 930 bytes} [Sun Jul 31 14:15:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:15:06.174588 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-d0b4b52e-b6d3-45c5-880c-b1f9bb2dab4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "os-flavor-access:is_public": true, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 8, "disk": 160, "id": "5"}} {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:15:06.194188 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-d0b4b52e-b6d3-45c5-880c-b1f9bb2dab4d admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.461783 Jul 31 14:15:06.194751 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 18/34] 10.222.0.40 () {64 vars in 1282 bytes} [Sun Jul 31 14:15:05 2022] POST /compute/v2.1/flavors => generated 408 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 14:15:06.207095 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-6b7a3718-a660-46fa-904d-f55048f2d5a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:15:06.213413 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:15:06.236424 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-6b7a3718-a660-46fa-904d-f55048f2d5a2 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033377 Jul 31 14:15:06.237215 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 17/35] 10.222.0.40 () {64 vars in 1332 bytes} [Sun Jul 31 14:15:06 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:15:26.794541 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-d0b4b52e-b6d3-45c5-880c-b1f9bb2dab4d admin admin] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:26.795600 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-d0b4b52e-b6d3-45c5-880c-b1f9bb2dab4d admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 31 14:15:26.796007 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 19/36] 10.222.0.40 () {54 vars in 930 bytes} [Sun Jul 31 14:15:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:15:27.183032 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-bff5df7c-0e36-4b87-a5cb-77b656b9fe02 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:27.201527 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-bff5df7c-0e36-4b87-a5cb-77b656b9fe02 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399622 Jul 31 14:15:27.202052 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1291 bytes} [Sun Jul 31 14:15:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:15:28.276998 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-d0b4b52e-b6d3-45c5-880c-b1f9bb2dab4d admin admin] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:28.278013 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-d0b4b52e-b6d3-45c5-880c-b1f9bb2dab4d admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 31 14:15:28.278421 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 20/38] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Jul 31 14:15:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:15:28.793309 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-64456676-f8f1-4635-9bf8-f93b2d2c99fc admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:28.799414 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.wsgi [None req-64456676-f8f1-4635-9bf8-f93b2d2c99fc admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 31 14:15:28.802709 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-64456676-f8f1-4635-9bf8-f93b2d2c99fc admin admin] Request method failure captured: Jul 31 14:15:28.802709 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 31 14:15:28.802709 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: Accept: application/json Jul 31 14:15:28.802709 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: Accept-Encoding: gzip, deflate Jul 31 14:15:28.802709 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: Connection: keep-alive Jul 31 14:15:28.802709 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: Content-Length: 0 Jul 31 14:15:28.802709 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: Host: 10.222.0.40 Jul 31 14:15:28.802709 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: Openstack-Api-Version: compute 2.90 Jul 31 14:15:28.802709 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: Openstack-System-Scope: None Jul 31 14:15:28.802709 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: User-Agent: python-novaclient Jul 31 14:15:28.802709 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Auth-Token: gAAAAABi5o6A44Pp_kCLslOeT-LvJP72Z1XF6OhwMFcE7DpFKm3_BqVA0mtH6BLMYcDcApiSQPpKOfe68OrYTNLfZbaewtr6V2OinGYpo51YCuqcDFFyFmCnp2i4uCj85R4rTiWUphBrWwekSo3uWcQerOhSMbonT-4W6eGGP4_m7Hi6ZLb_UqE Jul 31 14:15:28.802709 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Domain-Id: None Jul 31 14:15:28.802709 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Domain-Name: None Jul 31 14:15:28.802709 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Identity-Status: Confirmed Jul 31 14:15:28.802709 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Is-Admin-Project: True Jul 31 14:15:28.802709 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 14:15:28.802709 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Project-Domain-Id: default Jul 31 14:15:28.802709 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Project-Domain-Name: Default Jul 31 14:15:28.802709 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Project-Id: 0e21ca24dfa94435a41c5ab2bd838cb9 Jul 31 14:15:28.802709 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Project-Name: admin Jul 31 14:15:28.802709 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Role: reader,member,admin Jul 31 14:15:28.802709 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Roles: reader,member,admin Jul 31 14:15:28.804294 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e21ca24dfa94435a41c5ab2bd838cb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0e21ca24dfa94435a41c5ab2bd838cb9", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0e21ca24dfa94435a41c5ab2bd838cb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e21ca24dfa94435a41c5ab2bd838cb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:15:28.804294 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Tenant: admin Jul 31 14:15:28.804294 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Tenant-Id: 0e21ca24dfa94435a41c5ab2bd838cb9 Jul 31 14:15:28.804294 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Tenant-Name: admin Jul 31 14:15:28.804294 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-User: admin Jul 31 14:15:28.804294 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-User-Domain-Id: default Jul 31 14:15:28.804294 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-User-Domain-Name: Default Jul 31 14:15:28.804294 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-User-Id: da5b1c90e892464380eacee9a29f0449 Jul 31 14:15:28.804294 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-User-Name: admin Jul 31 14:15:28.804294 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: method: > Jul 31 14:15:28.804294 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: exception: Flavor 42 could not be found. Jul 31 14:15:28.804294 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: action_args: {'id': '42'} Jul 31 14:15:28.804294 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:15:28.804294 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:15:28.805321 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 14:15:28.805321 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 14:15:28.805321 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 14:15:28.805321 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 14:15:28.805321 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 14:15:28.805321 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 14:15:28.805321 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 14:15:28.805321 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 14:15:28.805321 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 14:15:28.805321 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:15:28.805321 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 14:15:28.805321 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 14:15:28.805321 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 31 14:15:28.805321 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 31 14:15:28.805321 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:15:28.805321 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 31 14:15:28.805321 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:15:28.805321 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:15:28.805321 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:15:28.806639 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:15:28.806639 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:15:28.806639 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:15:28.806639 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:15:28.806639 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 14:15:28.806639 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:15:28.806639 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 31 14:15:28.806639 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 31 14:15:28.806639 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:15:28.806639 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 31 14:15:28.806639 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:15:28.806639 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:15:28.806639 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:15:28.806639 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:15:28.806639 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:15:28.806639 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 31 14:15:28.806639 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 31 14:15:28.806639 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-64456676-f8f1-4635-9bf8-f93b2d2c99fc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:15:28.808044 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-64456676-f8f1-4635-9bf8-f93b2d2c99fc admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.386518 Jul 31 14:15:28.808044 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1190 bytes} [Sun Jul 31 14:15:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 31 14:15:28.814238 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-29527742-e071-4507-bdd3-f02573f76f61 admin admin] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:28.818507 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG dbcounter [-] [103132] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:15:28.837714 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-29527742-e071-4507-bdd3-f02573f76f61 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027577 Jul 31 14:15:28.838257 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 21/40] 10.222.0.40 () {60 vars in 1210 bytes} [Sun Jul 31 14:15:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:15:28.847838 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-5cc65b2a-8853-4f1a-a390-15f02ebb8d01 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:28.871463 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-5cc65b2a-8853-4f1a-a390-15f02ebb8d01 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027122 Jul 31 14:15:28.872107 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1210 bytes} [Sun Jul 31 14:15:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:15:28.882382 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-2d3e79f4-47cf-4a59-bf67-48b9804270c6 admin admin] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:28.888511 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.wsgi [None req-2d3e79f4-47cf-4a59-bf67-48b9804270c6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 31 14:15:28.891764 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-2d3e79f4-47cf-4a59-bf67-48b9804270c6 admin admin] Request method failure captured: Jul 31 14:15:28.891764 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 31 14:15:28.891764 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: Accept: application/json Jul 31 14:15:28.891764 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: Accept-Encoding: gzip, deflate Jul 31 14:15:28.891764 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: Connection: keep-alive Jul 31 14:15:28.891764 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: Content-Length: 0 Jul 31 14:15:28.891764 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: Host: 10.222.0.40 Jul 31 14:15:28.891764 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: Openstack-Api-Version: compute 2.90 Jul 31 14:15:28.891764 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: Openstack-System-Scope: None Jul 31 14:15:28.891764 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: User-Agent: python-novaclient Jul 31 14:15:28.891764 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Auth-Token: gAAAAABi5o6A44Pp_kCLslOeT-LvJP72Z1XF6OhwMFcE7DpFKm3_BqVA0mtH6BLMYcDcApiSQPpKOfe68OrYTNLfZbaewtr6V2OinGYpo51YCuqcDFFyFmCnp2i4uCj85R4rTiWUphBrWwekSo3uWcQerOhSMbonT-4W6eGGP4_m7Hi6ZLb_UqE Jul 31 14:15:28.891764 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Domain-Id: None Jul 31 14:15:28.891764 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Domain-Name: None Jul 31 14:15:28.891764 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Identity-Status: Confirmed Jul 31 14:15:28.891764 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Is-Admin-Project: True Jul 31 14:15:28.891764 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 14:15:28.891764 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Project-Domain-Id: default Jul 31 14:15:28.891764 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Project-Domain-Name: Default Jul 31 14:15:28.891764 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Project-Id: 0e21ca24dfa94435a41c5ab2bd838cb9 Jul 31 14:15:28.891764 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Project-Name: admin Jul 31 14:15:28.891764 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Role: reader,member,admin Jul 31 14:15:28.891764 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Roles: reader,member,admin Jul 31 14:15:28.893250 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e21ca24dfa94435a41c5ab2bd838cb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0e21ca24dfa94435a41c5ab2bd838cb9", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0e21ca24dfa94435a41c5ab2bd838cb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e21ca24dfa94435a41c5ab2bd838cb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:15:28.893250 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Tenant: admin Jul 31 14:15:28.893250 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Tenant-Id: 0e21ca24dfa94435a41c5ab2bd838cb9 Jul 31 14:15:28.893250 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Tenant-Name: admin Jul 31 14:15:28.893250 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-User: admin Jul 31 14:15:28.893250 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-User-Domain-Id: default Jul 31 14:15:28.893250 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-User-Domain-Name: Default Jul 31 14:15:28.893250 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-User-Id: da5b1c90e892464380eacee9a29f0449 Jul 31 14:15:28.893250 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-User-Name: admin Jul 31 14:15:28.893250 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: method: > Jul 31 14:15:28.893250 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: exception: Flavor 42 could not be found. Jul 31 14:15:28.893250 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: action_args: {'id': '42'} Jul 31 14:15:28.893250 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:15:28.893250 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:15:28.894196 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 14:15:28.894196 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 14:15:28.894196 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 14:15:28.894196 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 14:15:28.894196 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 14:15:28.894196 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 14:15:28.894196 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 14:15:28.894196 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 14:15:28.894196 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 14:15:28.894196 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:15:28.894196 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 14:15:28.894196 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 14:15:28.894196 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 31 14:15:28.894196 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Jul 31 14:15:28.894196 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:15:28.894196 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Jul 31 14:15:28.894196 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:15:28.894196 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:15:28.894196 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:15:28.895456 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:15:28.895456 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:15:28.895456 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:15:28.895456 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:15:28.895456 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 14:15:28.895456 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:15:28.895456 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 31 14:15:28.895456 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Jul 31 14:15:28.895456 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:15:28.895456 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Jul 31 14:15:28.895456 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:15:28.895456 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:15:28.895456 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:15:28.895456 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:15:28.895456 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:15:28.895456 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 31 14:15:28.895456 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Jul 31 14:15:28.895456 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-2d3e79f4-47cf-4a59-bf67-48b9804270c6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:15:28.896666 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-2d3e79f4-47cf-4a59-bf67-48b9804270c6 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014873 Jul 31 14:15:28.896666 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 22/42] 10.222.0.40 () {60 vars in 1190 bytes} [Sun Jul 31 14:15:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 31 14:15:29.864669 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-5cc65b2a-8853-4f1a-a390-15f02ebb8d01 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:29.865682 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-5cc65b2a-8853-4f1a-a390-15f02ebb8d01 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 31 14:15:29.866078 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 21/43] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Jul 31 14:15:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:15:30.381894 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-cc2e6a49-8f81-405c-91f6-03a0b376959c admin admin] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:30.387150 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.wsgi [None req-cc2e6a49-8f81-405c-91f6-03a0b376959c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 31 14:15:30.388687 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-cc2e6a49-8f81-405c-91f6-03a0b376959c admin admin] Request method failure captured: Jul 31 14:15:30.388687 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 31 14:15:30.388687 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: Accept: application/json Jul 31 14:15:30.388687 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: Accept-Encoding: gzip, deflate Jul 31 14:15:30.388687 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: Connection: keep-alive Jul 31 14:15:30.388687 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: Content-Length: 0 Jul 31 14:15:30.388687 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: Host: 10.222.0.40 Jul 31 14:15:30.388687 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: Openstack-Api-Version: compute 2.90 Jul 31 14:15:30.388687 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: Openstack-System-Scope: None Jul 31 14:15:30.388687 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: User-Agent: python-novaclient Jul 31 14:15:30.388687 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Auth-Token: gAAAAABi5o6BDzQbXF6Zs04HVJAmoikqJfgdWTExC1YrPmbXecGpg1CpV0M2Pr1tTo3fMApwNn0r_JYlYMscpGKaUBvgNhyZQd3lfd85FxyMqUKcNxxXWEGC_9HRUtiSWW53VMQUNF4TjnD3zNOzxjJ6nIFPhS6MZyxrFvAbvgboWD2qGj0JoqY Jul 31 14:15:30.388687 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Domain-Id: None Jul 31 14:15:30.388687 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Domain-Name: None Jul 31 14:15:30.388687 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Identity-Status: Confirmed Jul 31 14:15:30.388687 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Is-Admin-Project: True Jul 31 14:15:30.388687 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 14:15:30.388687 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Project-Domain-Id: default Jul 31 14:15:30.388687 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Project-Domain-Name: Default Jul 31 14:15:30.388687 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Project-Id: 0e21ca24dfa94435a41c5ab2bd838cb9 Jul 31 14:15:30.388687 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Project-Name: admin Jul 31 14:15:30.388687 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Role: reader,member,admin Jul 31 14:15:30.388687 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Roles: reader,member,admin Jul 31 14:15:30.390190 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e21ca24dfa94435a41c5ab2bd838cb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0e21ca24dfa94435a41c5ab2bd838cb9", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0e21ca24dfa94435a41c5ab2bd838cb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e21ca24dfa94435a41c5ab2bd838cb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:15:30.390190 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Tenant: admin Jul 31 14:15:30.390190 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Tenant-Id: 0e21ca24dfa94435a41c5ab2bd838cb9 Jul 31 14:15:30.390190 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Tenant-Name: admin Jul 31 14:15:30.390190 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-User: admin Jul 31 14:15:30.390190 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-User-Domain-Id: default Jul 31 14:15:30.390190 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-User-Domain-Name: Default Jul 31 14:15:30.390190 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-User-Id: da5b1c90e892464380eacee9a29f0449 Jul 31 14:15:30.390190 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-User-Name: admin Jul 31 14:15:30.390190 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: method: > Jul 31 14:15:30.390190 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: exception: Flavor 84 could not be found. Jul 31 14:15:30.390190 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: action_args: {'id': '84'} Jul 31 14:15:30.390190 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:15:30.390190 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:15:30.391100 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 14:15:30.391100 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 14:15:30.391100 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 14:15:30.391100 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 14:15:30.391100 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 14:15:30.391100 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 14:15:30.391100 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 14:15:30.391100 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 14:15:30.391100 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 14:15:30.391100 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:15:30.391100 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 14:15:30.391100 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 14:15:30.391100 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 31 14:15:30.391100 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Jul 31 14:15:30.391100 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:15:30.391100 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Jul 31 14:15:30.391100 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:15:30.391100 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:15:30.391100 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:15:30.392529 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:15:30.392529 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:15:30.392529 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:15:30.392529 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:15:30.392529 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 14:15:30.392529 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:15:30.392529 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 31 14:15:30.392529 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Jul 31 14:15:30.392529 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:15:30.392529 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Jul 31 14:15:30.392529 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:15:30.392529 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:15:30.392529 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:15:30.392529 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:15:30.392529 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:15:30.392529 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 31 14:15:30.392529 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Jul 31 14:15:30.392529 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-cc2e6a49-8f81-405c-91f6-03a0b376959c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:15:30.393739 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-cc2e6a49-8f81-405c-91f6-03a0b376959c admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.386757 Jul 31 14:15:30.393739 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1190 bytes} [Sun Jul 31 14:15:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 31 14:15:30.399896 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-e71827b7-1288-4973-9172-0fcbc816d358 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:30.414491 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-e71827b7-1288-4973-9172-0fcbc816d358 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018212 Jul 31 14:15:30.415007 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 22/45] 10.222.0.40 () {60 vars in 1210 bytes} [Sun Jul 31 14:15:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:15:30.424757 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-45208176-8687-4764-af21-0c99582f9e78 admin admin] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:30.440358 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-45208176-8687-4764-af21-0c99582f9e78 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019593 Jul 31 14:15:30.440881 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1210 bytes} [Sun Jul 31 14:15:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:15:30.449772 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-33ceeed6-f7c7-45bd-8db7-c2feefc9249f admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:30.454936 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.wsgi [None req-33ceeed6-f7c7-45bd-8db7-c2feefc9249f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 31 14:15:30.456443 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-33ceeed6-f7c7-45bd-8db7-c2feefc9249f admin admin] Request method failure captured: Jul 31 14:15:30.456443 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 31 14:15:30.456443 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: Accept: application/json Jul 31 14:15:30.456443 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: Accept-Encoding: gzip, deflate Jul 31 14:15:30.456443 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: Connection: keep-alive Jul 31 14:15:30.456443 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: Content-Length: 0 Jul 31 14:15:30.456443 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: Host: 10.222.0.40 Jul 31 14:15:30.456443 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: Openstack-Api-Version: compute 2.90 Jul 31 14:15:30.456443 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: Openstack-System-Scope: None Jul 31 14:15:30.456443 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: User-Agent: python-novaclient Jul 31 14:15:30.456443 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Auth-Token: gAAAAABi5o6BDzQbXF6Zs04HVJAmoikqJfgdWTExC1YrPmbXecGpg1CpV0M2Pr1tTo3fMApwNn0r_JYlYMscpGKaUBvgNhyZQd3lfd85FxyMqUKcNxxXWEGC_9HRUtiSWW53VMQUNF4TjnD3zNOzxjJ6nIFPhS6MZyxrFvAbvgboWD2qGj0JoqY Jul 31 14:15:30.456443 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Domain-Id: None Jul 31 14:15:30.456443 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Domain-Name: None Jul 31 14:15:30.456443 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Identity-Status: Confirmed Jul 31 14:15:30.456443 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Is-Admin-Project: True Jul 31 14:15:30.456443 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 14:15:30.456443 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Project-Domain-Id: default Jul 31 14:15:30.456443 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Project-Domain-Name: Default Jul 31 14:15:30.456443 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Project-Id: 0e21ca24dfa94435a41c5ab2bd838cb9 Jul 31 14:15:30.456443 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Project-Name: admin Jul 31 14:15:30.456443 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Role: reader,member,admin Jul 31 14:15:30.456443 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Roles: reader,member,admin Jul 31 14:15:30.457983 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e21ca24dfa94435a41c5ab2bd838cb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0e21ca24dfa94435a41c5ab2bd838cb9", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0e21ca24dfa94435a41c5ab2bd838cb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e21ca24dfa94435a41c5ab2bd838cb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:15:30.457983 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Tenant: admin Jul 31 14:15:30.457983 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Tenant-Id: 0e21ca24dfa94435a41c5ab2bd838cb9 Jul 31 14:15:30.457983 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Tenant-Name: admin Jul 31 14:15:30.457983 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-User: admin Jul 31 14:15:30.457983 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-User-Domain-Id: default Jul 31 14:15:30.457983 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-User-Domain-Name: Default Jul 31 14:15:30.457983 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-User-Id: da5b1c90e892464380eacee9a29f0449 Jul 31 14:15:30.457983 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-User-Name: admin Jul 31 14:15:30.457983 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: method: > Jul 31 14:15:30.457983 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: exception: Flavor 84 could not be found. Jul 31 14:15:30.457983 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: action_args: {'id': '84'} Jul 31 14:15:30.457983 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:15:30.457983 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:15:30.458912 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 14:15:30.458912 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 14:15:30.458912 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 14:15:30.458912 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 14:15:30.458912 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 14:15:30.458912 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 14:15:30.458912 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 14:15:30.458912 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 14:15:30.458912 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 14:15:30.458912 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:15:30.458912 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 14:15:30.458912 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 14:15:30.458912 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 31 14:15:30.458912 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 31 14:15:30.458912 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:15:30.458912 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 31 14:15:30.458912 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:15:30.458912 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:15:30.458912 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:15:30.460238 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:15:30.460238 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:15:30.460238 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:15:30.460238 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:15:30.460238 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 14:15:30.460238 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:15:30.460238 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 31 14:15:30.460238 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 31 14:15:30.460238 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:15:30.460238 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 31 14:15:30.460238 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:15:30.460238 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:15:30.460238 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:15:30.460238 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:15:30.460238 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:15:30.460238 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 31 14:15:30.460238 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 31 14:15:30.460238 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-33ceeed6-f7c7-45bd-8db7-c2feefc9249f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:15:30.461478 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-33ceeed6-f7c7-45bd-8db7-c2feefc9249f admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011448 Jul 31 14:15:30.461478 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 23/47] 10.222.0.40 () {60 vars in 1190 bytes} [Sun Jul 31 14:15:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 31 14:15:31.423534 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-45208176-8687-4764-af21-0c99582f9e78 admin admin] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:31.424534 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-45208176-8687-4764-af21-0c99582f9e78 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 31 14:15:31.424935 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 25/48] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Jul 31 14:15:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:15:31.956436 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-e5da0f02-cca9-47a1-bdbd-4ba48921d841 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:31.962300 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.wsgi [None req-e5da0f02-cca9-47a1-bdbd-4ba48921d841 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 31 14:15:31.963926 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-e5da0f02-cca9-47a1-bdbd-4ba48921d841 admin admin] Request method failure captured: Jul 31 14:15:31.963926 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 31 14:15:31.963926 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: Accept: application/json Jul 31 14:15:31.963926 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: Accept-Encoding: gzip, deflate Jul 31 14:15:31.963926 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: Connection: keep-alive Jul 31 14:15:31.963926 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: Content-Length: 0 Jul 31 14:15:31.963926 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: Host: 10.222.0.40 Jul 31 14:15:31.963926 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: Openstack-Api-Version: compute 2.90 Jul 31 14:15:31.963926 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: Openstack-System-Scope: None Jul 31 14:15:31.963926 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: User-Agent: python-novaclient Jul 31 14:15:31.963926 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Auth-Token: gAAAAABi5o6D0Mtufz652eIP2UmSdb3hthF2wDBwfXB6SJ7svI9AZReDdTnBGqc762V1oMG2BbGQ8HeDO368M4B5K7VjQqNtShMGfuBuz0H3v7H_T5jO6So64Lh2XBDmuo88Rajkk1BIKTvUfqOZgJXcioKLf43Ev9qf19wJXGf-PB9mQgnmus4 Jul 31 14:15:31.963926 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Domain-Id: None Jul 31 14:15:31.963926 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Domain-Name: None Jul 31 14:15:31.963926 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Identity-Status: Confirmed Jul 31 14:15:31.963926 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Is-Admin-Project: True Jul 31 14:15:31.963926 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 14:15:31.963926 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Project-Domain-Id: default Jul 31 14:15:31.963926 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Project-Domain-Name: Default Jul 31 14:15:31.963926 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Project-Id: 0e21ca24dfa94435a41c5ab2bd838cb9 Jul 31 14:15:31.963926 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Project-Name: admin Jul 31 14:15:31.963926 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Role: reader,member,admin Jul 31 14:15:31.963926 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Roles: reader,member,admin Jul 31 14:15:31.965671 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e21ca24dfa94435a41c5ab2bd838cb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0e21ca24dfa94435a41c5ab2bd838cb9", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0e21ca24dfa94435a41c5ab2bd838cb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e21ca24dfa94435a41c5ab2bd838cb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:15:31.965671 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Tenant: admin Jul 31 14:15:31.965671 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Tenant-Id: 0e21ca24dfa94435a41c5ab2bd838cb9 Jul 31 14:15:31.965671 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-Tenant-Name: admin Jul 31 14:15:31.965671 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-User: admin Jul 31 14:15:31.965671 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-User-Domain-Id: default Jul 31 14:15:31.965671 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-User-Domain-Name: Default Jul 31 14:15:31.965671 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-User-Id: da5b1c90e892464380eacee9a29f0449 Jul 31 14:15:31.965671 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: X-User-Name: admin Jul 31 14:15:31.965671 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: method: > Jul 31 14:15:31.965671 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: exception: Flavor 451 could not be found. Jul 31 14:15:31.965671 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: action_args: {'id': '451'} Jul 31 14:15:31.965671 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:15:31.965671 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:15:31.966537 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 14:15:31.966537 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 14:15:31.966537 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 14:15:31.966537 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 14:15:31.966537 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 14:15:31.966537 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 14:15:31.966537 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 14:15:31.966537 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 14:15:31.966537 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 14:15:31.966537 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:15:31.966537 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 14:15:31.966537 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 14:15:31.966537 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 31 14:15:31.966537 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 31 14:15:31.966537 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:15:31.966537 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 31 14:15:31.966537 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:15:31.966537 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:15:31.966537 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:15:31.967667 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:15:31.967667 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:15:31.967667 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:15:31.967667 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:15:31.967667 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 14:15:31.967667 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:15:31.967667 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 31 14:15:31.967667 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 31 14:15:31.967667 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:15:31.967667 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 31 14:15:31.967667 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:15:31.967667 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:15:31.967667 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:15:31.967667 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:15:31.967667 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:15:31.967667 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 31 14:15:31.967667 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: ERROR nova.api.openstack.wsgi Jul 31 14:15:31.967667 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-e5da0f02-cca9-47a1-bdbd-4ba48921d841 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:15:31.968750 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-e5da0f02-cca9-47a1-bdbd-4ba48921d841 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.403488 Jul 31 14:15:31.968750 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 24/49] 10.222.0.40 () {60 vars in 1193 bytes} [Sun Jul 31 14:15:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 31 14:15:31.977776 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-335fff50-fd3f-4baa-90a3-9f8399682e7f admin admin] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:31.994691 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-335fff50-fd3f-4baa-90a3-9f8399682e7f admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023166 Jul 31 14:15:31.995244 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 26/50] 10.222.0.40 () {60 vars in 1210 bytes} [Sun Jul 31 14:15:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:15:32.005469 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-263537e9-4811-40b7-8505-6a127ecbce59 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:32.020046 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-263537e9-4811-40b7-8505-6a127ecbce59 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018816 Jul 31 14:15:32.020567 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 25/51] 10.222.0.40 () {60 vars in 1210 bytes} [Sun Jul 31 14:15:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:15:32.029427 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-74d71fc9-85ff-463b-b781-439315f5ecb5 admin admin] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:32.035254 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.wsgi [None req-74d71fc9-85ff-463b-b781-439315f5ecb5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 31 14:15:32.036782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-74d71fc9-85ff-463b-b781-439315f5ecb5 admin admin] Request method failure captured: Jul 31 14:15:32.036782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 31 14:15:32.036782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: Accept: application/json Jul 31 14:15:32.036782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: Accept-Encoding: gzip, deflate Jul 31 14:15:32.036782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: Connection: keep-alive Jul 31 14:15:32.036782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: Content-Length: 0 Jul 31 14:15:32.036782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: Host: 10.222.0.40 Jul 31 14:15:32.036782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: Openstack-Api-Version: compute 2.90 Jul 31 14:15:32.036782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: Openstack-System-Scope: None Jul 31 14:15:32.036782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: User-Agent: python-novaclient Jul 31 14:15:32.036782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Auth-Token: gAAAAABi5o6D0Mtufz652eIP2UmSdb3hthF2wDBwfXB6SJ7svI9AZReDdTnBGqc762V1oMG2BbGQ8HeDO368M4B5K7VjQqNtShMGfuBuz0H3v7H_T5jO6So64Lh2XBDmuo88Rajkk1BIKTvUfqOZgJXcioKLf43Ev9qf19wJXGf-PB9mQgnmus4 Jul 31 14:15:32.036782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Domain-Id: None Jul 31 14:15:32.036782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Domain-Name: None Jul 31 14:15:32.036782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Identity-Status: Confirmed Jul 31 14:15:32.036782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Is-Admin-Project: True Jul 31 14:15:32.036782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Openstack-Nova-Api-Version: 2.90 Jul 31 14:15:32.036782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Project-Domain-Id: default Jul 31 14:15:32.036782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Project-Domain-Name: Default Jul 31 14:15:32.036782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Project-Id: 0e21ca24dfa94435a41c5ab2bd838cb9 Jul 31 14:15:32.036782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Project-Name: admin Jul 31 14:15:32.036782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Role: reader,member,admin Jul 31 14:15:32.036782 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Roles: reader,member,admin Jul 31 14:15:32.038335 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e21ca24dfa94435a41c5ab2bd838cb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_0e21ca24dfa94435a41c5ab2bd838cb9", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/0e21ca24dfa94435a41c5ab2bd838cb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/0e21ca24dfa94435a41c5ab2bd838cb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:15:32.038335 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Tenant: admin Jul 31 14:15:32.038335 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Tenant-Id: 0e21ca24dfa94435a41c5ab2bd838cb9 Jul 31 14:15:32.038335 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-Tenant-Name: admin Jul 31 14:15:32.038335 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-User: admin Jul 31 14:15:32.038335 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-User-Domain-Id: default Jul 31 14:15:32.038335 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-User-Domain-Name: Default Jul 31 14:15:32.038335 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-User-Id: da5b1c90e892464380eacee9a29f0449 Jul 31 14:15:32.038335 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: X-User-Name: admin Jul 31 14:15:32.038335 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: method: > Jul 31 14:15:32.038335 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: exception: Flavor 451 could not be found. Jul 31 14:15:32.038335 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: action_args: {'id': '451'} Jul 31 14:15:32.038335 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:15:32.038335 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:15:32.039198 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 31 14:15:32.039198 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 31 14:15:32.039198 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 31 14:15:32.039198 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 31 14:15:32.039198 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 14:15:32.039198 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 14:15:32.039198 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 31 14:15:32.039198 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 31 14:15:32.039198 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 31 14:15:32.039198 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:15:32.039198 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 31 14:15:32.039198 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 31 14:15:32.039198 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 31 14:15:32.039198 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Jul 31 14:15:32.039198 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:15:32.039198 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Jul 31 14:15:32.039198 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:15:32.039198 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:15:32.039198 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:15:32.040622 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:15:32.040622 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:15:32.040622 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:15:32.040622 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:15:32.040622 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 31 14:15:32.040622 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:15:32.040622 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 31 14:15:32.040622 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Jul 31 14:15:32.040622 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:15:32.040622 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Jul 31 14:15:32.040622 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:15:32.040622 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:15:32.040622 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:15:32.040622 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:15:32.040622 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:15:32.040622 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 31 14:15:32.040622 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: ERROR nova.api.openstack.wsgi Jul 31 14:15:32.040622 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-74d71fc9-85ff-463b-b781-439315f5ecb5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103132) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:15:32.041926 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-74d71fc9-85ff-463b-b781-439315f5ecb5 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012205 Jul 31 14:15:32.041926 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 27/52] 10.222.0.40 () {60 vars in 1193 bytes} [Sun Jul 31 14:15:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 31 14:15:33.032914 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-263537e9-4811-40b7-8505-6a127ecbce59 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:33.033929 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-263537e9-4811-40b7-8505-6a127ecbce59 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Jul 31 14:15:33.034323 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 26/53] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Jul 31 14:15:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:15:33.573691 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-cb41c1f6-9532-4dba-976a-6bde1ba2bbe7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:15:33.592887 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-cb41c1f6-9532-4dba-976a-6bde1ba2bbe7 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.423192 Jul 31 14:15:33.593368 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 28/54] 10.222.0.40 () {64 vars in 1235 bytes} [Sun Jul 31 14:15:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 14:15:34.594600 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-263537e9-4811-40b7-8505-6a127ecbce59 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:34.595652 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-263537e9-4811-40b7-8505-6a127ecbce59 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 31 14:15:34.596042 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Jul 31 14:15:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:15:35.108307 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-0fe36b74-0ada-4ae9-bdcd-6bb717a6671b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:15:35.128161 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-0fe36b74-0ada-4ae9-bdcd-6bb717a6671b admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.397680 Jul 31 14:15:35.128717 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 29/56] 10.222.0.40 () {64 vars in 1235 bytes} [Sun Jul 31 14:15:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 14:15:36.082501 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-263537e9-4811-40b7-8505-6a127ecbce59 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:36.083650 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-263537e9-4811-40b7-8505-6a127ecbce59 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jul 31 14:15:36.084040 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 28/57] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Jul 31 14:15:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:15:36.608472 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-c0fb2cd4-1dc4-4fce-afd6-7e77c9b8de5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:15:36.627775 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-c0fb2cd4-1dc4-4fce-afd6-7e77c9b8de5d admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.408432 Jul 31 14:15:36.628319 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 30/58] 10.222.0.40 () {64 vars in 1235 bytes} [Sun Jul 31 14:15:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 14:15:37.594916 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-263537e9-4811-40b7-8505-6a127ecbce59 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:37.595941 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-263537e9-4811-40b7-8505-6a127ecbce59 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jul 31 14:15:37.596332 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 29/59] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Jul 31 14:15:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:15:38.124742 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-7cf37be5-d5cf-4c93-a15a-743b85363e31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:15:38.143197 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-7cf37be5-d5cf-4c93-a15a-743b85363e31 admin admin] 10.222.0.40 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.411223 Jul 31 14:15:38.143883 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 31/60] 10.222.0.40 () {64 vars in 1235 bytes} [Sun Jul 31 14:15:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 14:15:39.118113 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-263537e9-4811-40b7-8505-6a127ecbce59 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:39.119111 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-263537e9-4811-40b7-8505-6a127ecbce59 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 31 14:15:39.119596 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 30/61] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Jul 31 14:15:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:15:39.637530 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-6fda3332-ae69-431a-bb51-995decaebef2 admin admin] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:15:39.658095 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-6fda3332-ae69-431a-bb51-995decaebef2 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.402148 Jul 31 14:15:39.658630 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 32/62] 10.222.0.40 () {60 vars in 1202 bytes} [Sun Jul 31 14:15:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:16:31.057117 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-263537e9-4811-40b7-8505-6a127ecbce59 admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:16:31.058134 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-263537e9-4811-40b7-8505-6a127ecbce59 admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 31 14:16:31.058535 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 31/63] 10.222.0.40 () {54 vars in 930 bytes} [Sun Jul 31 14:16:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:16:31.069246 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG dbcounter [-] [103132] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:16:31.444481 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-eb0d842d-7d74-4341-8085-7ba1a923875d admin admin] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:16:31.465080 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-eb0d842d-7d74-4341-8085-7ba1a923875d admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.400499 Jul 31 14:16:31.465630 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 33/64] 10.222.0.40 () {60 vars in 1291 bytes} [Sun Jul 31 14:16:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:16:31.488757 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-33cb742c-988b-4ed7-9a00-d0eacd425c4f admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:16:31.492203 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG dbcounter [-] [103133] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:16:31.497685 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-33cb742c-988b-4ed7-9a00-d0eacd425c4f admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012573 Jul 31 14:16:31.498197 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 32/65] 10.222.0.40 () {60 vars in 1282 bytes} [Sun Jul 31 14:16:31 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:16:31.510120 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-a58f44a2-e9c6-4185-98f4-18c059476de8 admin admin] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:16:31.518274 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-a58f44a2-e9c6-4185-98f4-18c059476de8 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011714 Jul 31 14:16:31.518788 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 34/66] 10.222.0.40 () {60 vars in 1285 bytes} [Sun Jul 31 14:16:31 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:16:31.529833 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-28e8cf2d-fed4-4e31-9892-90e24c78828f admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:16:31.538006 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-28e8cf2d-fed4-4e31-9892-90e24c78828f admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011716 Jul 31 14:16:31.538519 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 33/67] 10.222.0.40 () {60 vars in 1285 bytes} [Sun Jul 31 14:16:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:16:31.549545 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-79d5a9b9-bfef-49ca-9a3f-1f2b575cb279 admin admin] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:16:31.557050 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-79d5a9b9-bfef-49ca-9a3f-1f2b575cb279 admin admin] 10.222.0.40 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011009 Jul 31 14:16:31.557576 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 35/68] 10.222.0.40 () {60 vars in 1282 bytes} [Sun Jul 31 14:16:31 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:20:41.022406 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-28e8cf2d-fed4-4e31-9892-90e24c78828f admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:20:41.023404 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-28e8cf2d-fed4-4e31-9892-90e24c78828f admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 31 14:20:41.023829 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 34/69] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Jul 31 14:20:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:20:41.163154 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG dbcounter [-] [103132] Writing DB stats nova_api:SELECT=6 {{(pid=103132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:20:41.319408 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-b83b7490-896d-4c38-8e73-5921a2ead57b admin admin] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:20:41.321800 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 14:20:41.321800 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: warnings.warn(msg) Jul 31 14:20:41.323081 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_concurrency.lockutils [None req-b83b7490-896d-4c38-8e73-5921a2ead57b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:20:41.323823 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_concurrency.lockutils [None req-b83b7490-896d-4c38-8e73-5921a2ead57b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:20:41.324626 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_concurrency.lockutils [None req-b83b7490-896d-4c38-8e73-5921a2ead57b admin admin] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:20:41.325061 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_concurrency.lockutils [None req-b83b7490-896d-4c38-8e73-5921a2ead57b admin admin] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:20:41.358673 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-b83b7490-896d-4c38-8e73-5921a2ead57b admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.197487 Jul 31 14:20:41.359229 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 36/70] 10.222.0.40 () {60 vars in 1193 bytes} [Sun Jul 31 14:20:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 14:20:42.194263 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-28e8cf2d-fed4-4e31-9892-90e24c78828f admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:20:42.195266 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-28e8cf2d-fed4-4e31-9892-90e24c78828f admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jul 31 14:20:42.195704 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Jul 31 14:20:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:20:42.386513 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-b3148c7e-e085-4641-b29f-0b78ffdc6a7a admin admin] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:20:42.389065 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 14:20:42.389065 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: warnings.warn(msg) Jul 31 14:20:42.390340 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_concurrency.lockutils [None req-b3148c7e-e085-4641-b29f-0b78ffdc6a7a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:20:42.391824 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_concurrency.lockutils [None req-b3148c7e-e085-4641-b29f-0b78ffdc6a7a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:20:42.392624 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_concurrency.lockutils [None req-b3148c7e-e085-4641-b29f-0b78ffdc6a7a admin admin] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:20:42.393057 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_concurrency.lockutils [None req-b3148c7e-e085-4641-b29f-0b78ffdc6a7a admin admin] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:20:42.416044 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-b3148c7e-e085-4641-b29f-0b78ffdc6a7a admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083318 Jul 31 14:20:42.416542 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 37/72] 10.222.0.40 () {60 vars in 1193 bytes} [Sun Jul 31 14:20:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 14:20:53.674452 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-28e8cf2d-fed4-4e31-9892-90e24c78828f admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:20:53.675481 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-28e8cf2d-fed4-4e31-9892-90e24c78828f admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jul 31 14:20:53.675883 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Jul 31 14:20:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:20:53.819280 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG dbcounter [-] [103132] Writing DB stats nova_cell0:SELECT=4 {{(pid=103132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:20:53.820033 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG dbcounter [-] [103132] Writing DB stats nova_cell1:SELECT=4 {{(pid=103132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:20:53.820718 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG dbcounter [-] [103132] Writing DB stats nova_api:SELECT=8 {{(pid=103132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:20:53.868001 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-8c5ba275-0162-486e-99e7-0e747baf1560 admin admin] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:20:53.870428 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 14:20:53.870428 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: warnings.warn(msg) Jul 31 14:20:53.871657 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_concurrency.lockutils [None req-8c5ba275-0162-486e-99e7-0e747baf1560 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:20:53.872104 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_concurrency.lockutils [None req-8c5ba275-0162-486e-99e7-0e747baf1560 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:20:53.872928 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_concurrency.lockutils [None req-8c5ba275-0162-486e-99e7-0e747baf1560 admin admin] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:20:53.873362 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_concurrency.lockutils [None req-8c5ba275-0162-486e-99e7-0e747baf1560 admin admin] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:20:53.898349 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-8c5ba275-0162-486e-99e7-0e747baf1560 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083392 Jul 31 14:20:53.898830 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 38/74] 10.222.0.40 () {60 vars in 1193 bytes} [Sun Jul 31 14:20:53 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:20:54.731495 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: DEBUG nova.api.openstack.wsgi [None req-28e8cf2d-fed4-4e31-9892-90e24c78828f admin admin] Calling method '>' {{(pid=103133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:20:54.732493 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: INFO nova.api.openstack.requestlog [None req-28e8cf2d-fed4-4e31-9892-90e24c78828f admin admin] 10.222.0.40 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 31 14:20:54.732884 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: [pid: 103133|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1074 bytes} [Sun Jul 31 14:20:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:20:54.924042 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG nova.api.openstack.wsgi [None req-37186ef1-09c1-4e17-ad4e-06682a7c2e10 admin admin] Calling method '>' {{(pid=103132) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:20:54.926423 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 31 14:20:54.926423 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: warnings.warn(msg) Jul 31 14:20:54.927684 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_concurrency.lockutils [None req-37186ef1-09c1-4e17-ad4e-06682a7c2e10 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:20:54.928758 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_concurrency.lockutils [None req-37186ef1-09c1-4e17-ad4e-06682a7c2e10 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:20:54.929541 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_concurrency.lockutils [None req-37186ef1-09c1-4e17-ad4e-06682a7c2e10 admin admin] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:20:54.929973 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: DEBUG oslo_concurrency.lockutils [None req-37186ef1-09c1-4e17-ad4e-06682a7c2e10 admin admin] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103132) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:20:54.951476 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: INFO nova.api.openstack.requestlog [None req-37186ef1-09c1-4e17-ad4e-06682a7c2e10 admin admin] 10.222.0.40 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.077218 Jul 31 14:20:54.951954 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: [pid: 103132|app: 0|req: 39/76] 10.222.0.40 () {60 vars in 1193 bytes} [Sun Jul 31 14:20:54 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:21:49.116962 dv-cinder-849846-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 31 14:21:49.117500 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: Sun Jul 31 14:21:49 2022 - graceful shutdown triggered... Jul 31 14:21:49.117946 dv-cinder-849846-4-iscsi devstack@n-api.service[103132]: Gracefully killing worker 1 (pid: 103132)... Jul 31 14:21:49.118322 dv-cinder-849846-4-iscsi devstack@n-api.service[103133]: Gracefully killing worker 2 (pid: 103133)... Jul 31 14:21:50.118417 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: worker 1 buried after 1 seconds Jul 31 14:21:50.118976 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: worker 2 buried after 1 seconds Jul 31 14:21:50.118976 dv-cinder-849846-4-iscsi devstack@n-api.service[103131]: goodbye to uWSGI. Jul 31 14:21:50.120037 dv-cinder-849846-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 31 14:21:50.120620 dv-cinder-849846-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 31 14:21:50.123387 dv-cinder-849846-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 31 14:21:50.135029 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 31 14:21:50.137696 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jul 31 14:21:50 2022] *** Jul 31 14:21:50.137696 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 31 14:21:50.137696 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 31 14:21:50.137696 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: nodename: dv-cinder-849846-4-iscsi Jul 31 14:21:50.137696 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: machine: x86_64 Jul 31 14:21:50.137696 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: clock source: unix Jul 31 14:21:50.137696 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: pcre jit disabled Jul 31 14:21:50.137696 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: detected number of CPU cores: 4 Jul 31 14:21:50.137696 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: current working directory: / Jul 31 14:21:50.137696 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: detected binary path: /usr/bin/uwsgi-core Jul 31 14:21:50.137696 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: your processes number limit is 47680 Jul 31 14:21:50.137696 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: your memory page size is 4096 bytes Jul 31 14:21:50.138616 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: detected max file descriptor number: 2048 Jul 31 14:21:50.138616 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: lock engine: pthread robust mutexes Jul 31 14:21:50.138616 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: thunder lock: enabled Jul 31 14:21:50.138616 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 31 14:21:50.138616 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 31 14:21:50.179261 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: Python main interpreter initialized at 0x56016112a9c0 Jul 31 14:21:50.179261 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: python threads support enabled Jul 31 14:21:50.179261 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: your server socket listen backlog is limited to 100 connections Jul 31 14:21:50.179261 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: your mercy for graceful operations on workers is 90 seconds Jul 31 14:21:50.179809 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: mapped 403077 bytes (393 KB) for 2 cores Jul 31 14:21:50.179809 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: *** Operational MODE: preforking *** Jul 31 14:21:50.180003 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: *** uWSGI is running in multiple interpreter mode *** Jul 31 14:21:50.180003 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: spawned uWSGI master process (pid: 117763) Jul 31 14:21:50.180206 dv-cinder-849846-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 31 14:21:50.180772 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: spawned uWSGI worker 1 (pid: 117780, cores: 1) Jul 31 14:21:50.181317 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: spawned uWSGI worker 2 (pid: 117781, cores: 1) Jul 31 14:21:50.181637 dv-cinder-849846-4-iscsi devstack@n-api.service[117763]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 31 14:21:50.835753 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 31 14:21:50.836575 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 31 14:21:51.993168 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 14:21:51.993168 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: from cryptography.utils import int_from_bytes Jul 31 14:21:51.993962 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 14:21:51.993962 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: from cryptography.utils import int_from_bytes Jul 31 14:21:52.001639 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 14:21:52.001639 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: from cryptography.utils import int_from_bytes Jul 31 14:21:52.002087 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 31 14:21:52.002087 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: from cryptography.utils import int_from_bytes Jul 31 14:21:54.398962 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 14:21:54.399806 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 14:21:54.399806 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 14:21:54.400181 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 14:21:54.400362 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 14:21:54.400719 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.401052 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.401385 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.401710 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.402045 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.402355 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.402680 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.403001 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.403332 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.403620 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.403939 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.404264 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-4-iscsi {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.404586 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.405074 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.405393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.405719 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.406027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.406349 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.406673 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.407181 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.408576 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.408576 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.408576 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.408915 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.409194 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.409452 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.409773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.410087 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.410421 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.410761 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.411155 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-4-iscsi {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.411502 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.411813 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.412131 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.412559 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.412877 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.413192 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.413519 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.414510 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.414821 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.415154 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.415505 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.415850 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.416156 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.416460 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.416773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.417084 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.417404 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.417717 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.418023 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.418274 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.418584 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.418905 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.419225 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.419572 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.419836 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.420073 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.420397 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.420717 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.421030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.421346 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.421659 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.421968 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.422286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.422594 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.422906 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.423220 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.423558 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.423879 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.424207 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.424519 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.424843 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.425254 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.425505 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.425828 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.426166 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.426488 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.426794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.427114 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.427499 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.427776 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.428087 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.428398 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.428716 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.429051 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.429402 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.429662 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.429967 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.430276 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.430598 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.430906 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.431215 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.431550 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.431856 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.432162 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.432474 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.432781 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.433089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.433400 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.433704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.434013 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.434320 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.434628 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.434945 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.435255 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.435651 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.435899 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.436217 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.436621 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.436842 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.437149 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.437459 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.437788 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.438097 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.438405 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.438721 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.438986 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 31 14:21:54.439580 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.439740 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 31 14:21:54.439887 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.439887 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.440173 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 31 14:21:54.440318 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.440470 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 31 14:21:54.440639 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.440798 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 31 14:21:54.440952 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.441102 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.441260 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.441413 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.441716 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.441900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.442051 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.442203 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.442442 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.442617 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.442851 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.443004 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.443155 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.443300 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.443497 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.443497 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.443931 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.444091 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.444243 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.444243 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.444526 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.444677 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.444821 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.444988 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849846-4-iscsi {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.445218 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.445388 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.445536 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.445536 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.445937 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.446096 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.446241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.446399 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.446551 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.446904 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.447070 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.447223 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.447368 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.447553 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.447714 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.447870 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.448027 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.448201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.448357 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.448503 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.448646 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.448788 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.448939 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.449091 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.449551 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.449714 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.449859 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.450013 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.450158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.450307 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.450460 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.450613 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.450764 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.450917 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.451068 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.451222 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.451377 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.451546 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.451847 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849846-4-iscsi {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.452001 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.452168 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.452315 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.452550 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.452701 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.452872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.453097 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.453259 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.453414 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.453558 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.453718 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.453948 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.454098 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.454269 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.454429 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.454574 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.454725 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.454876 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.455035 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.455207 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.455462 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.455628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.455836 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.456067 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.456231 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.456377 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.456539 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.456685 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.456846 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.457164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.457406 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.457555 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.457707 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.457864 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.458017 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.458170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.458325 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.458470 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.458470 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.458762 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.458914 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.459072 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.459236 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.459645 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.459837 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.459991 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.460144 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.460307 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.460459 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.461094 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.461270 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.461455 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.461615 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.461932 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.462107 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.462262 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.462415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.462578 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.462816 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.462967 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.463135 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.463356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.463577 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.463737 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.463917 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.464154 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.464314 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.464461 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.464604 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.464747 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.464908 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.465053 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.465208 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.465352 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.465592 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.465754 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.465911 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.466082 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.466302 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.466453 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.466597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.466751 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.466906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.40 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.467053 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.467407 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.40 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.467580 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.467743 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.467910 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.468067 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.468211 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.468354 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.468505 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.468649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.468801 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.468953 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.469105 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.469257 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.469428 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.469743 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.469903 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.470048 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.470212 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.470357 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.470500 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.470655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.470808 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.470960 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.471114 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.471265 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.471265 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.471618 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.471765 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.472070 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.472229 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.472402 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.472555 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.472709 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.472956 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.473117 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.473278 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.473528 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.473682 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.473834 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.473994 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.474158 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.474387 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.474549 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.474702 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.474847 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.474999 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.475144 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.475289 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.475466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.475889 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.476063 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.476217 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.487538 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.488213 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.488299 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.488401 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.488516 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.488600 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.488681 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.488754 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.488833 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.488914 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.488996 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.489074 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.489147 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.489227 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.489308 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.489390 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.489472 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.489551 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.489637 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.489710 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.489788 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.489861 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.489938 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.490018 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.490105 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.490186 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.490259 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.490337 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.490410 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.490487 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.490574 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.490647 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.490740 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.490840 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.490916 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.491000 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.491075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.491144 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.491144 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.491982 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.492227 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.492449 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.492599 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.492752 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.492752 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.492752 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.493182 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.493346 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.493492 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.493656 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.493809 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.493954 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.494098 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.494268 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.494413 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.494589 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.494741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.494893 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.495126 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.495275 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.495460 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.495626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.495772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.495917 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.496118 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.496276 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.496440 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.496586 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.496737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.496889 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.497043 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.497245 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.497395 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.497547 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.497698 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 31 14:21:54.497861 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.498016 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.498170 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.498360 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.498521 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.498666 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.499276 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.499480 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.499855 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.500023 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.500181 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.500406 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.500589 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.500745 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.500890 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.501034 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.501177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.501333 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.501571 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.501725 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.501869 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.502019 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.502175 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.502327 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.502486 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.502640 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.502793 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.502947 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.503091 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.503253 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.503399 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.503618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.503780 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.504120 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.504281 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.504436 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.504590 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.504736 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.504887 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.505032 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.505175 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.505331 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.505494 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.506666 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.506838 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.506989 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.507143 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.507303 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.507517 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.507716 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.507880 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.508038 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.508199 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.508199 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.508199 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.508199 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.508199 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.508883 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.509508 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.509665 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.509821 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.509969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.510121 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.510272 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.510427 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.510579 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.510723 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.510866 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.511030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.511185 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.511339 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.511545 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.511708 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.511897 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.512055 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.512210 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.512369 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.512515 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.512659 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.512809 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.512969 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.513128 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.513273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.513424 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.513567 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.513711 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.513862 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.514020 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.514200 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.514357 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.514503 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.514815 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.514991 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.514991 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.515307 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.515472 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.515634 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.515779 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.515967 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.516125 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.516271 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.516415 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.516557 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.516706 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.516864 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.516864 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.517196 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.517343 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.517486 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.517637 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.517791 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.517945 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.518132 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.518290 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.518436 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.518585 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.518743 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.518887 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.519030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.519664 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.519819 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.519962 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.520123 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.520269 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.520420 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.520565 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.520716 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.520875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.521020 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.521208 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.521367 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.521569 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.521721 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.521880 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.522032 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.522184 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.522337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.522488 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.522641 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.522798 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.522951 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.523646 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.523813 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.523969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.524132 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.524286 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.524286 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.524567 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.524712 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.525794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.525972 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.526123 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.526268 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.526412 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.526556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.526708 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.526868 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.527036 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.527182 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.527333 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.527533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.527696 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.527896 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.528063 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.528221 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.528474 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.528637 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.528790 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.528940 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.529102 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.529476 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.529858 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.530022 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.530174 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.530333 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.530486 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.530647 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.530813 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.530966 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.531116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.531272 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.531453 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.531682 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.531852 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.532053 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.532213 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.532364 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.532521 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.532683 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.532835 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.532987 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.533138 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.533295 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.533446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.533606 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.533777 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.533930 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.534090 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.534279 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.534458 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.534620 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.534773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.534931 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.535090 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.535242 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.535393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.535625 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.535779 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.535976 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.536216 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.536375 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.536542 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.536722 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.537437 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.537603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.537772 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.537926 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.538091 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.538253 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.538533 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.539373 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.540497 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.540776 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.541057 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.541353 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.541558 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.541774 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.541934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.542092 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.542260 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.542450 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.542615 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.542774 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.542946 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.543107 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.543259 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.543409 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.543687 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.543839 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.543990 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.544155 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.544344 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.544543 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.544699 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.544858 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.545009 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.545225 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.545386 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.545545 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.545703 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.545959 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.546226 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.546555 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.546839 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.547100 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.547364 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.547688 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.548003 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.548304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.548587 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.548587 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.549121 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.549327 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.549494 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.549763 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.550258 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.550501 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.550668 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.550872 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.551036 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.551197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.551197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.551566 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.551731 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.551931 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.552098 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.552098 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.552429 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.552587 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.552738 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.552904 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.552904 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.553203 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.553353 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.553353 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.553668 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.554454 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.554628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.554831 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.554831 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.555145 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.555295 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.555295 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.555624 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.555784 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.555784 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.556101 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.556260 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.556260 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.556555 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.556721 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.556873 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.557023 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.557174 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.557324 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.557474 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.557639 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.557639 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.557944 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.558105 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.558105 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.558414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.558616 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.558770 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.558962 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.559128 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.559282 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.559495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.559663 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.559943 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.560615 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.560799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.560953 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.561118 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.561278 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.561438 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.561591 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.561741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.561951 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.562117 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.562276 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.562429 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.562580 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.562730 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.562899 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.563095 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.563253 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.563412 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.563626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.563779 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.563944 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.564096 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.564245 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.564402 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.564571 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.564731 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.564895 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.565397 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.565565 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.565727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.565891 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.566044 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.566205 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.566364 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.566524 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.566683 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.566835 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.566986 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.567261 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.567485 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.567658 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.568051 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.568051 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.568367 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.568520 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.568520 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.568822 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.568935 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.569047 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.569174 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.569287 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.569399 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.569516 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.569635 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.569749 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.570014 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.570177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.570770 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.570770 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.571085 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.571221 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.571327 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.571430 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.571539 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.571628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.571716 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.571809 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.571897 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.572037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.572139 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.572234 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.572328 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.572430 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.572524 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.572618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.572711 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.572797 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.572797 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.572958 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.573045 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.573138 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.573231 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.573317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.573317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.573549 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.573646 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.573741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.573741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.574013 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.574118 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.574118 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.574542 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.574635 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.574635 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.574807 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.574907 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.574907 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.575077 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.575216 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.575322 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.575322 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.575496 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.575594 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.575688 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.575787 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.575881 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.575968 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.576060 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.576146 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.576237 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.576336 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.576430 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.576523 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.576609 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.576732 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.576827 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.576922 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.577018 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.577018 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.577181 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.577266 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.577266 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.577429 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.577524 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.577524 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.577678 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.577768 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.577859 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.577957 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.577957 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.578131 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.578131 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.578304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.578404 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.578490 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.578581 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.578581 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.578735 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.578818 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.578818 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.578981 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.579080 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.579168 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.579253 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.579253 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.579489 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.579580 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.579676 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.579770 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.579770 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.579937 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.580024 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.580114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.580196 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.580196 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.580336 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.580448 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.580724 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.580830 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.580830 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.580994 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.581088 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.581188 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.581275 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.581275 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.581442 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.581528 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.581611 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.581707 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.581707 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.581870 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.581954 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.582095 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.582206 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.582206 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.582379 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.582466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.582556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.582648 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.582742 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.582835 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.582835 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.582835 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.583066 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.583149 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.583149 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.583369 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.583482 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.583482 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.583649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.583742 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.583742 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.583912 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.583996 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.584074 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.584153 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.584153 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.584294 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.584365 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.584456 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.584547 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.584547 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.584708 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.584794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.584885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.584977 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.584977 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.585145 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.585244 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.585330 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.585422 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.585422 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.586099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.586193 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.586289 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.586384 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.586384 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.586553 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.586648 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.586648 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.586824 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.586910 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.587000 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.587085 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.587085 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.587252 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.587340 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.587453 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.587543 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.587543 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.587700 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.587794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.587880 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.587972 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.587972 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.588135 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.588226 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.588320 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.588412 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.588412 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.588558 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.588649 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.588746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.588840 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.588840 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.588993 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.589076 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.589166 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.589260 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.589260 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.589430 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.589515 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.589605 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.589689 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.589689 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.589855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.589929 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.589929 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.590080 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.590163 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.590320 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.590409 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.590409 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.590576 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.591383 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.591514 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.591612 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.591612 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.591785 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.591871 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.591954 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.592046 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.592046 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.592269 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.592355 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.592438 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.592530 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.592530 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.592696 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.592821 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.592899 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.592979 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.592979 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.593162 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.593256 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.593341 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.593432 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.593432 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.593575 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.593657 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.593748 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.593835 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.593835 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.593979 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.594065 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.594139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.594216 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.594216 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.594351 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.594433 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.594829 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.594905 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.594985 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.595067 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.595067 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.595220 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.595301 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.595381 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.595605 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.595605 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.595763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.595763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.595763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.595959 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.596037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.596110 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.596189 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.596262 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.596333 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.596410 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.596482 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.596560 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.596641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.596722 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.596801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.596874 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.596951 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.597031 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.597105 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.597277 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.597369 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.597757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.598087 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.598412 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.598737 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.599065 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.599299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.599455 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.599778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.599875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.600092 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.600347 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.600488 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.600740 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.600882 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.601043 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.601939 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.602046 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.602261 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.602514 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.602619 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.602888 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.603002 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.603205 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.603520 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.603668 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.603966 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.604241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.604366 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.604486 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.604599 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.604946 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.605043 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.605289 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.605432 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.605609 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.605929 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.606032 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.606255 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.606433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.606758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.606858 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.607080 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.607187 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.607398 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.607594 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.607744 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.607877 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.608060 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.608159 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.608396 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.608498 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.608718 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.608836 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.609046 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.609142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.609356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.609455 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.609660 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.609751 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.609974 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.610117 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.610286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.610386 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.610594 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.610877 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.611102 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.611226 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.611350 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.611572 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.611863 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.612080 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.612176 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.612569 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.612709 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.613059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.613160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.613384 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.613538 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.613717 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.614020 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.614122 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.614358 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.614500 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.614671 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.614991 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.615104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.615300 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.615502 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.615636 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.615961 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.616065 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.616280 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.616591 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.616732 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.616944 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.617169 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.617264 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.617570 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.617702 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.617883 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.618042 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.618199 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.618331 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.618508 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.618642 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.618840 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.618961 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.619154 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.619291 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.619481 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.619673 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.619786 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.619985 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.620081 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.620295 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.620424 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.620626 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.620722 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.620933 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.621061 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.621255 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.621339 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.621581 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.621813 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.621907 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.622191 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.622283 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.622499 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.622751 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.622854 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.623108 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.623395 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.623569 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.623790 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.623918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.624119 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.624401 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.624495 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.624721 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.624900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.625040 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.625396 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.625505 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.625764 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.625890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.626080 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.626362 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.626457 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.626731 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.626848 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.627052 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.627329 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.627620 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.627869 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.627972 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.628267 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.628421 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.628605 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.628944 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.629036 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.629256 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.629348 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.629566 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.629715 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.629876 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.629969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.630203 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.630349 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.630520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.630615 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.630836 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.630975 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.631151 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.631295 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.631471 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.631648 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.631793 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.631965 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.632108 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.632289 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.632421 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.632651 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.632754 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.633061 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.633154 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.633374 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.633529 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.633687 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.633999 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.634099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.634313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.634468 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.634625 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.634978 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.635081 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.635282 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.635456 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.635628 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.635929 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.636032 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.636257 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.636412 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.636577 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.636893 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.636995 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.637203 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.637372 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.637516 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.637827 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.637929 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.638147 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.638297 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.638476 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.638789 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.638899 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.639100 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.639275 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.639621 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.639852 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.639965 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.640255 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.640369 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.640580 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.640843 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.640947 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.641207 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.641300 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.641531 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.641707 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.641848 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.642039 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.642176 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.642355 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.642492 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.642666 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.642824 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.642975 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.643167 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.643281 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.643521 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.643654 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.643850 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.643954 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.644160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.644269 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.644469 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.644588 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.644777 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.644968 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.645093 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.645217 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.645413 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.645551 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.645726 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.645880 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.646029 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.646197 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.646333 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.646513 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.646647 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.646837 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.646940 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.647141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.647234 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.647458 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.647571 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.647772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.647898 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.648575 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.648727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.648888 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.649059 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.649192 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.649321 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.649501 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.649632 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.649803 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.649936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.650103 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.650242 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.650402 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.650536 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.650721 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.650843 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.651025 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.651163 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.651342 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.651496 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.651677 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.651823 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.651978 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.652079 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.652279 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.652374 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.652581 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.652722 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.652925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.653020 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.653229 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.653323 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.653559 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.653654 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.653875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.653976 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.654195 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.654296 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.654507 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.654613 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.654823 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.654924 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.655142 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.655251 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.655479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.655582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.655795 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.655899 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.656112 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.656220 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.656428 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.656522 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.656743 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.656837 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.657057 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.657160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.657369 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.657460 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.657676 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.657767 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.657987 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.658089 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.658301 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.658392 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.658618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.658720 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.658930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.659180 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.659274 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.659534 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.659634 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.659852 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.659966 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.660166 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.660259 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.660479 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.660582 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.660796 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.660910 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.661116 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.661260 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.661426 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.661528 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.661735 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.661867 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.662046 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.662150 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.662367 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.662501 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.662677 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.662780 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.662995 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.663088 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.663312 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.663445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.663657 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.663820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.664559 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.664681 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.664897 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.665007 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.665211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.665311 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.665525 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.665619 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.665851 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.665953 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.666181 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.666275 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.666484 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.666575 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.666796 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.666899 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.667110 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.667218 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.667458 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.667556 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.667756 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.667860 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.668068 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.668162 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.668379 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.668472 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.668644 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117781) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 14:21:54.668784 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.668984 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.669292 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.669601 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.669911 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.670231 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.670563 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.670880 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.671197 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.671555 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.671876 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.672400 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.672717 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.673049 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.673372 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.673693 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.674010 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.674324 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.674650 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.674955 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.675257 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.675592 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.675900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.676200 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.676518 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.676828 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.677130 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.677449 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.677755 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.678292 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.678645 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.678965 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.679296 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.679677 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.679996 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.680304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.680629 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.680936 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.681246 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.681563 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.681876 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.682179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.682481 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.682794 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.683105 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.683407 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.683739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.684044 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.684371 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.684675 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.684979 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.685280 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.685590 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.685895 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.686196 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.686499 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.686800 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.687114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.687441 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.687748 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.688050 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.688359 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.688661 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.688969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.689323 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.689644 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.689945 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.690248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.690561 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.690966 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.691287 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.691624 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.691938 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.692283 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.692596 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.693132 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.693465 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.693785 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.694115 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.694445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.694751 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.695589 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.695896 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.696220 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.696533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.696843 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.697153 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.697463 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.697771 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.698079 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.698387 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.698697 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.699003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.699603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.699910 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.700218 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.700526 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.700839 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.701148 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.701491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.701810 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.702128 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.702441 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.702755 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.703065 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.703373 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.703706 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.704014 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.704329 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.704654 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.704965 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.705271 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.705685 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.705998 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.706314 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.706633 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.706941 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.707260 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.707606 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.707919 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.708239 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.708550 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.708877 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.709213 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.709543 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.709867 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.710169 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.710473 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.711411 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.711750 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.712069 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.712379 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.712683 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.712983 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.713293 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.713597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.713899 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.714199 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.714502 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.714807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.715105 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.715403 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.715724 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.716023 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.716324 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.716623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.716928 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.717228 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.717530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.717830 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.718129 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.718427 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.718753 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.719086 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.719395 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.719746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.720059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.720377 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.720685 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.721004 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.721388 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.721641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.721953 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.722287 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.722597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.722907 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.723219 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.723553 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.723865 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.724174 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.724497 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.724819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.725125 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.725447 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.725764 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.726083 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.726422 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.726736 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.727064 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.727376 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.727713 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.728024 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.728336 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.728646 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.728962 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.729271 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.729582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.729925 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO dbcounter [None req-dd7fe4e8-96e9-4c71-aaa1-f3c7fbe6d54e None None] Registered counter for database nova_api Jul 31 14:21:54.730046 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.730203 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.730526 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.730848 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.731157 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.731506 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.731831 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.732186 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.732486 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.732829 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.733153 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.733464 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.733777 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.734081 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 31 14:21:54.734321 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 31 14:21:54.749794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_db.sqlalchemy.engines [None req-dd7fe4e8-96e9-4c71-aaa1-f3c7fbe6d54e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117781) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 14:21:54.756512 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writer thread running {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 14:21:54.794757 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO dbcounter [None req-d039a6b4-069c-4380-9c3a-c3151676696f None None] Registered counter for database nova_api Jul 31 14:21:54.812491 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.context [None req-dd7fe4e8-96e9-4c71-aaa1-f3c7fbe6d54e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),75a43629-b1b3-47e1-9ca8-733d69d3b5de(cell1) {{(pid=117781) load_cells /opt/stack/nova/nova/context.py:464}} Jul 31 14:21:54.814586 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_db.sqlalchemy.engines [None req-d039a6b4-069c-4380-9c3a-c3151676696f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 14:21:54.816661 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dd7fe4e8-96e9-4c71-aaa1-f3c7fbe6d54e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:21:54.818264 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dd7fe4e8-96e9-4c71-aaa1-f3c7fbe6d54e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:21:54.819065 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dd7fe4e8-96e9-4c71-aaa1-f3c7fbe6d54e None None] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:21:54.821628 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dd7fe4e8-96e9-4c71-aaa1-f3c7fbe6d54e None None] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:21:54.821787 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writer thread running {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 14:21:54.823645 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO dbcounter [None req-dd7fe4e8-96e9-4c71-aaa1-f3c7fbe6d54e None None] Registered counter for database nova_cell0 Jul 31 14:21:54.828004 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO dbcounter [None req-dd7fe4e8-96e9-4c71-aaa1-f3c7fbe6d54e None None] Registered counter for database nova_cell1 Jul 31 14:21:54.835097 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_db.sqlalchemy.engines [None req-dd7fe4e8-96e9-4c71-aaa1-f3c7fbe6d54e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117781) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 14:21:54.837895 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_db.sqlalchemy.engines [None req-dd7fe4e8-96e9-4c71-aaa1-f3c7fbe6d54e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117781) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 14:21:54.842920 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writer thread running {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 14:21:54.848168 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writer thread running {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 14:21:54.877174 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.context [None req-d039a6b4-069c-4380-9c3a-c3151676696f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),75a43629-b1b3-47e1-9ca8-733d69d3b5de(cell1) {{(pid=117780) load_cells /opt/stack/nova/nova/context.py:464}} Jul 31 14:21:54.881295 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d039a6b4-069c-4380-9c3a-c3151676696f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:21:54.883405 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d039a6b4-069c-4380-9c3a-c3151676696f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:21:54.884211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d039a6b4-069c-4380-9c3a-c3151676696f None None] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:21:54.886200 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d039a6b4-069c-4380-9c3a-c3151676696f None None] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:21:54.888159 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO dbcounter [None req-d039a6b4-069c-4380-9c3a-c3151676696f None None] Registered counter for database nova_cell0 Jul 31 14:21:54.892088 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO dbcounter [None req-d039a6b4-069c-4380-9c3a-c3151676696f None None] Registered counter for database nova_cell1 Jul 31 14:21:54.900289 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_db.sqlalchemy.engines [None req-d039a6b4-069c-4380-9c3a-c3151676696f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 14:21:54.901061 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_db.sqlalchemy.engines [None req-d039a6b4-069c-4380-9c3a-c3151676696f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 14:21:54.907600 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writer thread running {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 14:21:54.996362 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO dbcounter [None req-dd7fe4e8-96e9-4c71-aaa1-f3c7fbe6d54e None None] Registered counter for database nova_cell0 Jul 31 14:21:55.003052 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_db.sqlalchemy.engines [None req-dd7fe4e8-96e9-4c71-aaa1-f3c7fbe6d54e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117781) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 14:21:55.008056 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writer thread running {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 14:21:55.057787 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writer thread running {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 14:21:55.068424 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO dbcounter [None req-d039a6b4-069c-4380-9c3a-c3151676696f None None] Registered counter for database nova_cell0 Jul 31 14:21:55.076253 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_db.sqlalchemy.engines [None req-d039a6b4-069c-4380-9c3a-c3151676696f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 31 14:21:55.080809 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writer thread running {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 31 14:21:55.329016 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: WARNING keystonemiddleware.auth_token [None req-dd7fe4e8-96e9-4c71-aaa1-f3c7fbe6d54e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 14:21:55.336847 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: WARNING keystonemiddleware.auth_token [None req-dd7fe4e8-96e9-4c71-aaa1-f3c7fbe6d54e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 14:21:55.401164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: WARNING keystonemiddleware.auth_token [None req-d039a6b4-069c-4380-9c3a-c3151676696f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 14:21:55.408504 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: WARNING keystonemiddleware.auth_token [None req-d039a6b4-069c-4380-9c3a-c3151676696f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 14:21:55.676961 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: WARNING keystonemiddleware.auth_token [None req-dd7fe4e8-96e9-4c71-aaa1-f3c7fbe6d54e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 14:21:55.683126 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: WARNING keystonemiddleware.auth_token [None req-dd7fe4e8-96e9-4c71-aaa1-f3c7fbe6d54e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 14:21:55.688528 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56016112a9c0 pid: 117781 (default app) Jul 31 14:21:55.750425 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: WARNING keystonemiddleware.auth_token [None req-d039a6b4-069c-4380-9c3a-c3151676696f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 31 14:21:55.756455 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: WARNING keystonemiddleware.auth_token [None req-d039a6b4-069c-4380-9c3a-c3151676696f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 31 14:21:55.761867 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56016112a9c0 pid: 117780 (default app) Jul 31 14:22:37.017397 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=3 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:22:37.018922 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=3 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:22:37.020131 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=3 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:22:37.021087 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=3 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:22:37.393375 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=3 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:22:37.394435 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=3 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:22:37.395511 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=3 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:22:37.396794 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=3 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:22:38.482229 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-487cc49a-e2a5-40c5-ae7f-b85689a6cd3a tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] Action: 'create', calling method: .version_select at 0x7f87eb9fbee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-134894608", "metadata": {"Type": "work"}}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:22:38.482925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-487cc49a-e2a5-40c5-ae7f-b85689a6cd3a tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] Request method failure captured: Jul 31 14:22:38.482925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 31 14:22:38.482925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:22:38.482925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:22:38.482925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:22:38.482925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 121 Jul 31 14:22:38.482925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:22:38.482925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:22:38.482925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:22:38.482925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:22:38.482925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pAtM962Hej5NmVqlgJ8Xr2s2JHb9uWLEOfxl-tsb5SbVi0m8ImPEaQIn8FowzyIMnuauS49hibeU5T0zGNFeucGCcVPzD7mNtpbGt7xCifQ7PMXoEGqRZpufF6JiWMwzhQx-jCDP48AYoPs4d1JNae7e-5dLzdBArhJSIJQljxDq3o Jul 31 14:22:38.482925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:22:38.482925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:22:38.482925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:22:38.482925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:22:38.482925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:22:38.482925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:22:38.482925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: af02bce9aa3c48a99a340d8f94f20a1d Jul 31 14:22:38.482925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-VolumesNegativeTest-1051655359 Jul 31 14:22:38.482925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:22:38.482925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:22:38.484236 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af02bce9aa3c48a99a340d8f94f20a1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af02bce9aa3c48a99a340d8f94f20a1d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af02bce9aa3c48a99a340d8f94f20a1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af02bce9aa3c48a99a340d8f94f20a1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:22:38.484236 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-VolumesNegativeTest-1051655359 Jul 31 14:22:38.484236 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: af02bce9aa3c48a99a340d8f94f20a1d Jul 31 14:22:38.484236 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-VolumesNegativeTest-1051655359 Jul 31 14:22:38.484236 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-VolumesNegativeTest-1051655359-project Jul 31 14:22:38.484236 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:22:38.484236 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:22:38.484236 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: 6012a1e24c0443de8b50b6b1f9d3acdf Jul 31 14:22:38.484236 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-VolumesNegativeTest-1051655359-project Jul 31 14:22:38.484236 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Jul 31 14:22:38.484236 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-134894608", "metadata": {"Type": "work"}}} Jul 31 14:22:38.484236 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: Jul 31 14:22:38.484236 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 31 14:22:38.485072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-134894608', 'metadata': {'Type': 'work'}}}} Jul 31 14:22:38.485072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:22:38.485072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:38.485072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 14:22:38.485072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 14:22:38.485072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 14:22:38.485072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise error Jul 31 14:22:38.485072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 31 14:22:38.485072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:38.485072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 31 14:22:38.485072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 31 14:22:38.485072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:38.485072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 31 14:22:38.485072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi '#$%' Jul 31 14:22:38.485072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:38.485072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:22:38.485072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:38.485072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:38.485072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:22:38.485072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:22:38.485072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:22:38.485072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:22:38.501164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 14:22:38.501164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 14:22:38.501164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:22:38.501164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:22:38.501164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 14:22:38.501164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 14:22:38.501164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 14:22:38.501164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 14:22:38.501164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 14:22:38.501164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 14:22:38.501164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 31 14:22:38.501164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:38.501164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:22:38.501164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:38.501164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:38.501164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:22:38.501164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:22:38.501164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 14:22:38.501164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 14:22:38.502797 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 31 14:22:38.502797 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:38.502797 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-487cc49a-e2a5-40c5-ae7f-b85689a6cd3a tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:22:38.502797 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-487cc49a-e2a5-40c5-ae7f-b85689a6cd3a tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.097393 Jul 31 14:22:38.502797 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 1/1] 10.222.0.40 () {60 vars in 1156 bytes} [Sun Jul 31 14:22:37 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 14:22:38.502797 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e1fe20e8-24cc-4921-a252-3568c3b9e15b tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] Action: 'create', calling method: .version_select at 0x7f87eb9939d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-99158995", "metadata": {"Type": "work"}}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:22:38.505799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e1fe20e8-24cc-4921-a252-3568c3b9e15b tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] Request method failure captured: Jul 31 14:22:38.505799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 31 14:22:38.505799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:22:38.505799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:22:38.505799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:22:38.505799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 118 Jul 31 14:22:38.505799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:22:38.505799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:22:38.505799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:22:38.505799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:22:38.505799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pAtM962Hej5NmVqlgJ8Xr2s2JHb9uWLEOfxl-tsb5SbVi0m8ImPEaQIn8FowzyIMnuauS49hibeU5T0zGNFeucGCcVPzD7mNtpbGt7xCifQ7PMXoEGqRZpufF6JiWMwzhQx-jCDP48AYoPs4d1JNae7e-5dLzdBArhJSIJQljxDq3o Jul 31 14:22:38.505799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:22:38.505799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:22:38.505799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:22:38.505799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:22:38.505799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:22:38.505799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:22:38.505799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: af02bce9aa3c48a99a340d8f94f20a1d Jul 31 14:22:38.505799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-VolumesNegativeTest-1051655359 Jul 31 14:22:38.505799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:22:38.505799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:22:38.508741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af02bce9aa3c48a99a340d8f94f20a1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af02bce9aa3c48a99a340d8f94f20a1d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af02bce9aa3c48a99a340d8f94f20a1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af02bce9aa3c48a99a340d8f94f20a1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:22:38.508741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-VolumesNegativeTest-1051655359 Jul 31 14:22:38.508741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: af02bce9aa3c48a99a340d8f94f20a1d Jul 31 14:22:38.508741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-VolumesNegativeTest-1051655359 Jul 31 14:22:38.508741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-VolumesNegativeTest-1051655359-project Jul 31 14:22:38.508741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:22:38.508741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:22:38.508741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: 6012a1e24c0443de8b50b6b1f9d3acdf Jul 31 14:22:38.508741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-VolumesNegativeTest-1051655359-project Jul 31 14:22:38.508741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Jul 31 14:22:38.508741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-99158995", "metadata": {"Type": "work"}}} Jul 31 14:22:38.508741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: Jul 31 14:22:38.508741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 31 14:22:38.510510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-99158995', 'metadata': {'Type': 'work'}}}} Jul 31 14:22:38.510510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:22:38.510510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:38.510510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 14:22:38.510510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 14:22:38.510510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 14:22:38.510510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise error Jul 31 14:22:38.510510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 31 14:22:38.510510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:38.510510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 31 14:22:38.510510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 31 14:22:38.510510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:38.510510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 31 14:22:38.510510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi '0' Jul 31 14:22:38.510510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:38.510510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:22:38.510510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:38.510510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:38.510510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:22:38.510510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:22:38.510510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:22:38.510510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:22:38.513299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 14:22:38.513299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 14:22:38.513299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:22:38.513299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:22:38.513299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 14:22:38.513299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 14:22:38.513299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 14:22:38.513299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 14:22:38.513299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 14:22:38.513299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 14:22:38.513299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 31 14:22:38.513299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:38.513299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:22:38.513299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:38.513299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:38.513299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:22:38.513299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:22:38.513299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 14:22:38.513299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 14:22:38.516313 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 31 14:22:38.516313 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:38.516313 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e1fe20e8-24cc-4921-a252-3568c3b9e15b tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:22:38.516313 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e1fe20e8-24cc-4921-a252-3568c3b9e15b tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010410 Jul 31 14:22:38.516313 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 2/2] 10.222.0.40 () {60 vars in 1156 bytes} [Sun Jul 31 14:22:38 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 14:22:38.518593 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-52683315-1b7d-4bb1-9197-639825a9764f tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] Action: 'create', calling method: .version_select at 0x7f87eb8b7a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1372856234", "metadata": {"Type": "work"}}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:22:38.520355 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b6eccbc6-52ed-490d-8387-ba3af3ca7a1a tempest-VolumesGetTestJSON-1437362591 tempest-VolumesGetTestJSON-1437362591-project] Action: 'create', calling method: .version_select at 0x7f87eb9fcee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1832517391", "metadata": {"Type": "work"}}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:22:38.523264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-52683315-1b7d-4bb1-9197-639825a9764f tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] Request method failure captured: Jul 31 14:22:38.523264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 31 14:22:38.523264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:22:38.523264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:22:38.523264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:22:38.523264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 119 Jul 31 14:22:38.523264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:22:38.523264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:22:38.523264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:22:38.523264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:22:38.523264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pAtM962Hej5NmVqlgJ8Xr2s2JHb9uWLEOfxl-tsb5SbVi0m8ImPEaQIn8FowzyIMnuauS49hibeU5T0zGNFeucGCcVPzD7mNtpbGt7xCifQ7PMXoEGqRZpufF6JiWMwzhQx-jCDP48AYoPs4d1JNae7e-5dLzdBArhJSIJQljxDq3o Jul 31 14:22:38.523264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:22:38.523264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:22:38.523264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:22:38.523264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:22:38.523264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:22:38.523264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:22:38.523264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: af02bce9aa3c48a99a340d8f94f20a1d Jul 31 14:22:38.523264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-VolumesNegativeTest-1051655359 Jul 31 14:22:38.523264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:22:38.523264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:22:38.524747 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af02bce9aa3c48a99a340d8f94f20a1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af02bce9aa3c48a99a340d8f94f20a1d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af02bce9aa3c48a99a340d8f94f20a1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af02bce9aa3c48a99a340d8f94f20a1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:22:38.524747 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-VolumesNegativeTest-1051655359 Jul 31 14:22:38.524747 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: af02bce9aa3c48a99a340d8f94f20a1d Jul 31 14:22:38.524747 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-VolumesNegativeTest-1051655359 Jul 31 14:22:38.524747 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-VolumesNegativeTest-1051655359-project Jul 31 14:22:38.524747 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:22:38.524747 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:22:38.524747 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: 6012a1e24c0443de8b50b6b1f9d3acdf Jul 31 14:22:38.524747 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-VolumesNegativeTest-1051655359-project Jul 31 14:22:38.524747 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Jul 31 14:22:38.524747 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1372856234", "metadata": {"Type": "work"}}} Jul 31 14:22:38.524747 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: Jul 31 14:22:38.524747 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 31 14:22:38.525578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1372856234', 'metadata': {'Type': 'work'}}}} Jul 31 14:22:38.525578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:22:38.525578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:38.525578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 31 14:22:38.525578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 31 14:22:38.525578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 31 14:22:38.525578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise error Jul 31 14:22:38.525578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 31 14:22:38.525578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:38.525578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 31 14:22:38.525578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 31 14:22:38.525578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:38.525578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 31 14:22:38.525578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi '' Jul 31 14:22:38.525578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:38.525578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:22:38.525578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:38.525578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:38.525578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:22:38.525578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:22:38.525578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:22:38.525578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:22:38.526875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 14:22:38.526875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 14:22:38.526875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:22:38.526875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:22:38.526875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 31 14:22:38.526875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 31 14:22:38.526875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 31 14:22:38.526875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 31 14:22:38.526875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 31 14:22:38.526875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 31 14:22:38.526875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 31 14:22:38.526875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:38.526875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:22:38.526875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:38.526875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:38.526875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:22:38.526875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:22:38.526875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 31 14:22:38.526875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 31 14:22:38.529297 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 31 14:22:38.529297 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:38.529297 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-52683315-1b7d-4bb1-9197-639825a9764f tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:22:38.529297 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-52683315-1b7d-4bb1-9197-639825a9764f tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009911 Jul 31 14:22:38.530991 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 3/3] 10.222.0.40 () {60 vars in 1156 bytes} [Sun Jul 31 14:22:38 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 14:22:38.536409 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-18de6081-7f38-4c99-86a1-8e27fefa0046 tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] Calling method '.version_select at 0x7f87eb8b7790>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:22:39.274514 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-18de6081-7f38-4c99-86a1-8e27fefa0046 tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] HTTP exception thrown: Volume tempest-invalid-701218852 could not be found. Jul 31 14:22:39.278556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-18de6081-7f38-4c99-86a1-8e27fefa0046 tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] Request method failure captured: Jul 31 14:22:39.278556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-701218852 HTTP/1.1 Jul 31 14:22:39.278556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:22:39.278556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:22:39.278556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:22:39.278556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:22:39.278556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:22:39.278556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:22:39.278556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:22:39.278556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:22:39.278556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pAtM962Hej5NmVqlgJ8Xr2s2JHb9uWLEOfxl-tsb5SbVi0m8ImPEaQIn8FowzyIMnuauS49hibeU5T0zGNFeucGCcVPzD7mNtpbGt7xCifQ7PMXoEGqRZpufF6JiWMwzhQx-jCDP48AYoPs4d1JNae7e-5dLzdBArhJSIJQljxDq3o Jul 31 14:22:39.278556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:22:39.278556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:22:39.278556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:22:39.278556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:22:39.278556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:22:39.278556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:22:39.278556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: af02bce9aa3c48a99a340d8f94f20a1d Jul 31 14:22:39.278556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-VolumesNegativeTest-1051655359 Jul 31 14:22:39.278556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:22:39.278556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:22:39.280048 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af02bce9aa3c48a99a340d8f94f20a1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af02bce9aa3c48a99a340d8f94f20a1d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af02bce9aa3c48a99a340d8f94f20a1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af02bce9aa3c48a99a340d8f94f20a1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:22:39.280048 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-VolumesNegativeTest-1051655359 Jul 31 14:22:39.280048 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: af02bce9aa3c48a99a340d8f94f20a1d Jul 31 14:22:39.280048 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-VolumesNegativeTest-1051655359 Jul 31 14:22:39.280048 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-VolumesNegativeTest-1051655359-project Jul 31 14:22:39.280048 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:22:39.280048 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:22:39.280048 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: 6012a1e24c0443de8b50b6b1f9d3acdf Jul 31 14:22:39.280048 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-VolumesNegativeTest-1051655359-project Jul 31 14:22:39.280048 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: Jul 31 14:22:39.280048 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Volume tempest-invalid-701218852 could not be found. Jul 31 14:22:39.280048 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': 'tempest-invalid-701218852'} Jul 31 14:22:39.280048 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:22:39.280942 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:39.280942 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 14:22:39.280942 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 14:22:39.280942 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 14:22:39.280942 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 14:22:39.280942 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 14:22:39.280942 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 14:22:39.280942 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 14:22:39.280942 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 14:22:39.280942 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 14:22:39.280942 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 14:22:39.280942 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 14:22:39.280942 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 14:22:39.280942 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 14:22:39.280942 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 14:22:39.280942 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-701218852 could not be found. (HTTP 404) (Request-ID: req-f99293d0-a67d-406b-9b0f-82c4649a5f44) Jul 31 14:22:39.280942 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:39.280942 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:22:39.280942 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:39.282158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:39.282158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 31 14:22:39.282158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 31 14:22:39.282158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 14:22:39.282158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 14:22:39.282158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 14:22:39.282158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 14:22:39.282158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 14:22:39.282158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 14:22:39.282158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 14:22:39.282158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 14:22:39.282158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 14:22:39.282158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 14:22:39.282158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 14:22:39.282158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 14:22:39.282158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 14:22:39.282158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 14:22:39.282158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 14:22:39.282158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 14:22:39.283304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 14:22:39.283304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 14:22:39.283304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 14:22:39.283304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 14:22:39.283304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-701218852 could not be found. Jul 31 14:22:39.283304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:39.283304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:22:39.283304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:39.283304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:39.283304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:22:39.283304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:22:39.283304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:22:39.283304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:22:39.283304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 14:22:39.283304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 14:22:39.283304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:22:39.283304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:22:39.283304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 31 14:22:39.283304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:22:39.283304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-701218852 could not be found. Jul 31 14:22:39.284849 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:39.284849 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:22:39.284849 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:39.284849 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:39.284849 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:22:39.284849 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:22:39.284849 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:22:39.284849 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:22:39.284849 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-701218852 could not be found. Jul 31 14:22:39.284849 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:39.287196 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-18de6081-7f38-4c99-86a1-8e27fefa0046 tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] Returning 404 to user: Volume tempest-invalid-701218852 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:22:39.288134 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-18de6081-7f38-4c99-86a1-8e27fefa0046 tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/tempest-invalid-701218852" status: 404 len: 98 microversion: 2.1 time: 0.756110 Jul 31 14:22:39.288699 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 4/4] 10.222.0.40 () {58 vars in 1215 bytes} [Sun Jul 31 14:22:38 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-701218852 => generated 98 bytes in 757 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 31 14:22:39.311894 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-127f1bd8-4756-40ee-a94e-8dfb409028a9 tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005567 Jul 31 14:22:39.315512 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 5/5] 10.222.0.40 () {58 vars in 1140 bytes} [Sun Jul 31 14:22:39 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 31 14:22:39.324258 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4c2d4087-91cb-459b-8ca3-f030ca50a0c5 tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006395 Jul 31 14:22:39.325034 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 6/6] 10.222.0.40 () {58 vars in 1137 bytes} [Sun Jul 31 14:22:39 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 31 14:22:39.333910 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-033dd321-8e09-4fc6-bf01-2eb576e8b8cd tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] Calling method '.version_select at 0x7f87eb803dc0>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:22:39.397564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-033dd321-8e09-4fc6-bf01-2eb576e8b8cd tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] HTTP exception thrown: Volume 4eade2a6-fe59-435f-882d-cfa3299e5a8a could not be found. Jul 31 14:22:39.399687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-033dd321-8e09-4fc6-bf01-2eb576e8b8cd tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] Request method failure captured: Jul 31 14:22:39.399687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: DELETE /compute/v2.1/os-volumes/4eade2a6-fe59-435f-882d-cfa3299e5a8a HTTP/1.1 Jul 31 14:22:39.399687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:22:39.399687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:22:39.399687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:22:39.399687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:22:39.399687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:22:39.399687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:22:39.399687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:22:39.399687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:22:39.399687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pAtM962Hej5NmVqlgJ8Xr2s2JHb9uWLEOfxl-tsb5SbVi0m8ImPEaQIn8FowzyIMnuauS49hibeU5T0zGNFeucGCcVPzD7mNtpbGt7xCifQ7PMXoEGqRZpufF6JiWMwzhQx-jCDP48AYoPs4d1JNae7e-5dLzdBArhJSIJQljxDq3o Jul 31 14:22:39.399687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:22:39.399687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:22:39.399687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:22:39.399687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:22:39.399687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:22:39.399687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:22:39.399687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: af02bce9aa3c48a99a340d8f94f20a1d Jul 31 14:22:39.399687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-VolumesNegativeTest-1051655359 Jul 31 14:22:39.399687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:22:39.399687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:22:39.401053 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af02bce9aa3c48a99a340d8f94f20a1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af02bce9aa3c48a99a340d8f94f20a1d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af02bce9aa3c48a99a340d8f94f20a1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af02bce9aa3c48a99a340d8f94f20a1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:22:39.401053 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-VolumesNegativeTest-1051655359 Jul 31 14:22:39.401053 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: af02bce9aa3c48a99a340d8f94f20a1d Jul 31 14:22:39.401053 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-VolumesNegativeTest-1051655359 Jul 31 14:22:39.401053 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-VolumesNegativeTest-1051655359-project Jul 31 14:22:39.401053 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:22:39.401053 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:22:39.401053 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: 6012a1e24c0443de8b50b6b1f9d3acdf Jul 31 14:22:39.401053 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-VolumesNegativeTest-1051655359-project Jul 31 14:22:39.401053 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: Jul 31 14:22:39.401053 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Volume 4eade2a6-fe59-435f-882d-cfa3299e5a8a could not be found. Jul 31 14:22:39.401053 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': '4eade2a6-fe59-435f-882d-cfa3299e5a8a'} Jul 31 14:22:39.401053 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:22:39.401885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:39.401885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 14:22:39.401885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 14:22:39.401885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 14:22:39.401885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 14:22:39.401885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 14:22:39.401885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 14:22:39.401885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 14:22:39.401885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 14:22:39.401885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 14:22:39.401885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 14:22:39.401885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 14:22:39.401885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 14:22:39.401885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 14:22:39.401885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 14:22:39.401885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4eade2a6-fe59-435f-882d-cfa3299e5a8a could not be found. (HTTP 404) (Request-ID: req-93e5a2c4-e2ff-4102-8ba5-1d0802d38b9c) Jul 31 14:22:39.401885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:39.401885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:22:39.401885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:39.402975 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:39.402975 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 31 14:22:39.402975 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 31 14:22:39.402975 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 14:22:39.402975 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 14:22:39.402975 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 14:22:39.402975 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 14:22:39.402975 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 14:22:39.402975 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 14:22:39.402975 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 14:22:39.402975 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 14:22:39.402975 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 14:22:39.402975 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 14:22:39.402975 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 14:22:39.402975 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 14:22:39.402975 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 14:22:39.402975 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 14:22:39.402975 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 14:22:39.402975 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 14:22:39.404170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 14:22:39.404170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 14:22:39.404170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 14:22:39.404170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 14:22:39.404170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4eade2a6-fe59-435f-882d-cfa3299e5a8a could not be found. Jul 31 14:22:39.404170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:39.404170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:22:39.404170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:39.404170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:39.404170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:22:39.404170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:22:39.404170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:22:39.404170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:22:39.404170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 14:22:39.404170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 14:22:39.404170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:22:39.404170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:22:39.404170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 31 14:22:39.404170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:22:39.408419 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4eade2a6-fe59-435f-882d-cfa3299e5a8a could not be found. Jul 31 14:22:39.408419 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:39.408419 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:22:39.408419 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:39.408419 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:39.408419 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:22:39.408419 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:22:39.408419 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:22:39.408419 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:22:39.408419 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4eade2a6-fe59-435f-882d-cfa3299e5a8a could not be found. Jul 31 14:22:39.408419 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:39.408419 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-033dd321-8e09-4fc6-bf01-2eb576e8b8cd tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] Returning 404 to user: Volume 4eade2a6-fe59-435f-882d-cfa3299e5a8a could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:22:39.408419 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-033dd321-8e09-4fc6-bf01-2eb576e8b8cd tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/4eade2a6-fe59-435f-882d-cfa3299e5a8a" status: 404 len: 109 microversion: 2.1 time: 0.071089 Jul 31 14:22:39.408419 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 7/7] 10.222.0.40 () {58 vars in 1248 bytes} [Sun Jul 31 14:22:39 2022] DELETE /compute/v2.1/os-volumes/4eade2a6-fe59-435f-882d-cfa3299e5a8a => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 14:22:39.416361 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-168d508b-86ed-4824-b2ee-023815db6567 tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] Calling method '.version_select at 0x7f87eb8ee820>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:22:39.508080 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-168d508b-86ed-4824-b2ee-023815db6567 tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] HTTP exception thrown: Volume a9a0808c-e6f3-474e-b69b-63ca60db7646 could not be found. Jul 31 14:22:39.512900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-168d508b-86ed-4824-b2ee-023815db6567 tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] Request method failure captured: Jul 31 14:22:39.512900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/os-volumes/a9a0808c-e6f3-474e-b69b-63ca60db7646 HTTP/1.1 Jul 31 14:22:39.512900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:22:39.512900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:22:39.512900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:22:39.512900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:22:39.512900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:22:39.512900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:22:39.512900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:22:39.512900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:22:39.512900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pAtM962Hej5NmVqlgJ8Xr2s2JHb9uWLEOfxl-tsb5SbVi0m8ImPEaQIn8FowzyIMnuauS49hibeU5T0zGNFeucGCcVPzD7mNtpbGt7xCifQ7PMXoEGqRZpufF6JiWMwzhQx-jCDP48AYoPs4d1JNae7e-5dLzdBArhJSIJQljxDq3o Jul 31 14:22:39.512900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:22:39.512900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:22:39.512900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:22:39.512900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:22:39.512900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:22:39.512900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:22:39.512900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: af02bce9aa3c48a99a340d8f94f20a1d Jul 31 14:22:39.512900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-VolumesNegativeTest-1051655359 Jul 31 14:22:39.512900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:22:39.512900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:22:39.514203 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af02bce9aa3c48a99a340d8f94f20a1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_af02bce9aa3c48a99a340d8f94f20a1d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/af02bce9aa3c48a99a340d8f94f20a1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/af02bce9aa3c48a99a340d8f94f20a1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:22:39.514203 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-VolumesNegativeTest-1051655359 Jul 31 14:22:39.514203 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: af02bce9aa3c48a99a340d8f94f20a1d Jul 31 14:22:39.514203 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-VolumesNegativeTest-1051655359 Jul 31 14:22:39.514203 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-VolumesNegativeTest-1051655359-project Jul 31 14:22:39.514203 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:22:39.514203 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:22:39.514203 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: 6012a1e24c0443de8b50b6b1f9d3acdf Jul 31 14:22:39.514203 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-VolumesNegativeTest-1051655359-project Jul 31 14:22:39.514203 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: Jul 31 14:22:39.514203 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Volume a9a0808c-e6f3-474e-b69b-63ca60db7646 could not be found. Jul 31 14:22:39.514203 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': 'a9a0808c-e6f3-474e-b69b-63ca60db7646'} Jul 31 14:22:39.514203 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:22:39.515059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:39.515059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 14:22:39.515059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 14:22:39.515059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 14:22:39.515059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 14:22:39.515059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 14:22:39.515059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 14:22:39.515059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 14:22:39.515059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 14:22:39.515059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 14:22:39.515059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 14:22:39.515059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 14:22:39.515059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 14:22:39.515059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 14:22:39.515059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 14:22:39.515059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a9a0808c-e6f3-474e-b69b-63ca60db7646 could not be found. (HTTP 404) (Request-ID: req-58233d57-931a-4b62-bcb3-2f96dffff020) Jul 31 14:22:39.515059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:39.515059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:22:39.515059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:39.516233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:39.516233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 31 14:22:39.516233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 31 14:22:39.516233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 14:22:39.516233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 14:22:39.516233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 14:22:39.516233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 14:22:39.516233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 14:22:39.516233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 14:22:39.516233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 14:22:39.516233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 14:22:39.516233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 14:22:39.516233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 14:22:39.516233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 14:22:39.516233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 14:22:39.516233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 14:22:39.516233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 14:22:39.516233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 14:22:39.516233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 14:22:39.517322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 14:22:39.517322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 14:22:39.517322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 14:22:39.517322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 14:22:39.517322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a9a0808c-e6f3-474e-b69b-63ca60db7646 could not be found. Jul 31 14:22:39.517322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:39.517322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:22:39.517322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:39.517322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:39.517322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:22:39.517322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:22:39.517322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:22:39.517322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:22:39.517322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 14:22:39.517322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 14:22:39.517322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:22:39.517322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:22:39.517322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 31 14:22:39.517322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:22:39.518389 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a9a0808c-e6f3-474e-b69b-63ca60db7646 could not be found. Jul 31 14:22:39.518389 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:39.518389 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:22:39.518389 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:39.518389 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:39.518389 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:22:39.518389 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:22:39.518389 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:22:39.518389 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:22:39.518389 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a9a0808c-e6f3-474e-b69b-63ca60db7646 could not be found. Jul 31 14:22:39.518389 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:22:39.520987 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-168d508b-86ed-4824-b2ee-023815db6567 tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] Returning 404 to user: Volume a9a0808c-e6f3-474e-b69b-63ca60db7646 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:22:39.523088 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-168d508b-86ed-4824-b2ee-023815db6567 tempest-VolumesNegativeTest-1051655359 tempest-VolumesNegativeTest-1051655359-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/a9a0808c-e6f3-474e-b69b-63ca60db7646" status: 404 len: 109 microversion: 2.1 time: 0.111521 Jul 31 14:22:39.524021 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 8/8] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Jul 31 14:22:39 2022] GET /compute/v2.1/os-volumes/a9a0808c-e6f3-474e-b69b-63ca60db7646 => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 14:22:40.265742 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b6eccbc6-52ed-490d-8387-ba3af3ca7a1a tempest-VolumesGetTestJSON-1437362591 tempest-VolumesGetTestJSON-1437362591-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.265218 Jul 31 14:22:40.267149 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 1/9] 10.222.0.40 () {60 vars in 1156 bytes} [Sun Jul 31 14:22:36 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3269 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 31 14:22:40.283679 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-03f87b12-0360-407c-a830-28edbcc237ea tempest-VolumesGetTestJSON-1437362591 tempest-VolumesGetTestJSON-1437362591-project] Calling method '.version_select at 0x7f87eb8ee700>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:22:40.413683 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-03f87b12-0360-407c-a830-28edbcc237ea tempest-VolumesGetTestJSON-1437362591 tempest-VolumesGetTestJSON-1437362591-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/94f910cd-4d09-4ed2-b3f6-4f7b86a7b341" status: 200 len: 353 microversion: 2.1 time: 0.100940 Jul 31 14:22:40.413683 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 9/10] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Jul 31 14:22:40 2022] GET /compute/v2.1/os-volumes/94f910cd-4d09-4ed2-b3f6-4f7b86a7b341 => generated 353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:22:41.413038 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-0ebc034e-feb0-4b2e-a654-5437ccd28cb2 tempest-VolumesGetTestJSON-1437362591 tempest-VolumesGetTestJSON-1437362591-project] Calling method '.version_select at 0x7f87eb87ed30>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:22:41.564153 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-0ebc034e-feb0-4b2e-a654-5437ccd28cb2 tempest-VolumesGetTestJSON-1437362591 tempest-VolumesGetTestJSON-1437362591-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/94f910cd-4d09-4ed2-b3f6-4f7b86a7b341" status: 200 len: 354 microversion: 2.1 time: 0.172314 Jul 31 14:22:41.568088 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 2/11] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Jul 31 14:22:41 2022] GET /compute/v2.1/os-volumes/94f910cd-4d09-4ed2-b3f6-4f7b86a7b341 => generated 354 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:22:41.581365 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-382c478d-0454-4264-98c3-179d458fdefd tempest-VolumesGetTestJSON-1437362591 tempest-VolumesGetTestJSON-1437362591-project] Calling method '.version_select at 0x7f87eb8034c0>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:22:41.653000 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-382c478d-0454-4264-98c3-179d458fdefd tempest-VolumesGetTestJSON-1437362591 tempest-VolumesGetTestJSON-1437362591-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/94f910cd-4d09-4ed2-b3f6-4f7b86a7b341" status: 200 len: 354 microversion: 2.1 time: 0.075881 Jul 31 14:22:41.656010 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 10/12] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Jul 31 14:22:41 2022] GET /compute/v2.1/os-volumes/94f910cd-4d09-4ed2-b3f6-4f7b86a7b341 => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:22:41.669068 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-158c3f79-707b-49bc-93ac-84087700a06c tempest-VolumesGetTestJSON-1437362591 tempest-VolumesGetTestJSON-1437362591-project] Calling method '.version_select at 0x7f87eb891430>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:22:41.834903 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-158c3f79-707b-49bc-93ac-84087700a06c tempest-VolumesGetTestJSON-1437362591 tempest-VolumesGetTestJSON-1437362591-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/94f910cd-4d09-4ed2-b3f6-4f7b86a7b341" status: 202 len: 0 microversion: 2.1 time: 0.169682 Jul 31 14:22:41.835530 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 3/13] 10.222.0.40 () {58 vars in 1248 bytes} [Sun Jul 31 14:22:41 2022] DELETE /compute/v2.1/os-volumes/94f910cd-4d09-4ed2-b3f6-4f7b86a7b341 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:22:41.845080 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-358897ef-eeae-4172-bc1d-9a2446d9fa59 tempest-VolumesGetTestJSON-1437362591 tempest-VolumesGetTestJSON-1437362591-project] Calling method '.version_select at 0x7f87eb8161f0>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:22:41.941748 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-358897ef-eeae-4172-bc1d-9a2446d9fa59 tempest-VolumesGetTestJSON-1437362591 tempest-VolumesGetTestJSON-1437362591-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/94f910cd-4d09-4ed2-b3f6-4f7b86a7b341" status: 200 len: 353 microversion: 2.1 time: 0.101365 Jul 31 14:22:41.942319 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 11/14] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Jul 31 14:22:41 2022] GET /compute/v2.1/os-volumes/94f910cd-4d09-4ed2-b3f6-4f7b86a7b341 => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:22:42.956555 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-694b5591-c207-4f18-a6ef-ed1f77f41f70 tempest-VolumesGetTestJSON-1437362591 tempest-VolumesGetTestJSON-1437362591-project] Calling method '.version_select at 0x7f87eb891af0>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:22:43.036241 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.wsgi [None req-694b5591-c207-4f18-a6ef-ed1f77f41f70 tempest-VolumesGetTestJSON-1437362591 tempest-VolumesGetTestJSON-1437362591-project] HTTP exception thrown: Volume 94f910cd-4d09-4ed2-b3f6-4f7b86a7b341 could not be found. Jul 31 14:22:43.041060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-694b5591-c207-4f18-a6ef-ed1f77f41f70 tempest-VolumesGetTestJSON-1437362591 tempest-VolumesGetTestJSON-1437362591-project] Request method failure captured: Jul 31 14:22:43.041060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: request: GET /compute/v2.1/os-volumes/94f910cd-4d09-4ed2-b3f6-4f7b86a7b341 HTTP/1.1 Jul 31 14:22:43.041060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept: application/json Jul 31 14:22:43.041060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept-Encoding: identity Jul 31 14:22:43.041060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Connection: close Jul 31 14:22:43.041060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Length: 0 Jul 31 14:22:43.041060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Type: application/json Jul 31 14:22:43.041060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Host: 10.222.0.40 Jul 31 14:22:43.041060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Openstack-System-Scope: None Jul 31 14:22:43.041060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: User-Agent: python-urllib3/1.26.10 Jul 31 14:22:43.041060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Auth-Token: gAAAAABi5pAsbu7Ppwm0SOj9ZyDNeizMvs-e9leG8gplW5_V9RUdI40Q_93ERexnyYijlCYpzWWTlCzw1YMAy3ShfgjHNpP2Tfcy3UqnuZK14x_fajKhxBRHdgc5hlAckpB2PPsJ5S3XmEXE8pIDqpPQ3grd2sdsXc9J07VK7QG8HKjIPaSvlSU Jul 31 14:22:43.041060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Id: None Jul 31 14:22:43.041060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Name: None Jul 31 14:22:43.041060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Identity-Status: Confirmed Jul 31 14:22:43.041060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Is-Admin-Project: True Jul 31 14:22:43.041060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Id: default Jul 31 14:22:43.041060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Name: Default Jul 31 14:22:43.041060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Id: eb1fb9777eab40bab0ae6d87404179aa Jul 31 14:22:43.041060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Name: tempest-VolumesGetTestJSON-1437362591 Jul 31 14:22:43.041060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Role: reader,member Jul 31 14:22:43.041060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Roles: reader,member Jul 31 14:22:43.042159 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eb1fb9777eab40bab0ae6d87404179aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_eb1fb9777eab40bab0ae6d87404179aa", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/eb1fb9777eab40bab0ae6d87404179aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/eb1fb9777eab40bab0ae6d87404179aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:22:43.042159 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant: tempest-VolumesGetTestJSON-1437362591 Jul 31 14:22:43.042159 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Id: eb1fb9777eab40bab0ae6d87404179aa Jul 31 14:22:43.042159 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Name: tempest-VolumesGetTestJSON-1437362591 Jul 31 14:22:43.042159 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User: tempest-VolumesGetTestJSON-1437362591-project Jul 31 14:22:43.042159 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Id: default Jul 31 14:22:43.042159 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Name: Default Jul 31 14:22:43.042159 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Id: c5a5bac128e648c180843db576447937 Jul 31 14:22:43.042159 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Name: tempest-VolumesGetTestJSON-1437362591-project Jul 31 14:22:43.042159 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: method: Jul 31 14:22:43.042159 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: exception: Volume 94f910cd-4d09-4ed2-b3f6-4f7b86a7b341 could not be found. Jul 31 14:22:43.042159 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: action_args: {'id': '94f910cd-4d09-4ed2-b3f6-4f7b86a7b341'} Jul 31 14:22:43.042159 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:22:43.042773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:43.042773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 14:22:43.042773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 14:22:43.042773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 14:22:43.042773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 14:22:43.042773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 14:22:43.042773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 14:22:43.042773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 14:22:43.042773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 14:22:43.042773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 14:22:43.042773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 14:22:43.042773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 14:22:43.042773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 14:22:43.042773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 14:22:43.042773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 14:22:43.042773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 94f910cd-4d09-4ed2-b3f6-4f7b86a7b341 could not be found. (HTTP 404) (Request-ID: req-0c310c89-dc5f-407f-8e48-f86e0859cf88) Jul 31 14:22:43.042773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:22:43.042773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:22:43.042773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:22:43.043854 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:43.043854 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 31 14:22:43.043854 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 31 14:22:43.043854 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 14:22:43.043854 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 14:22:43.043854 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 14:22:43.043854 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 14:22:43.043854 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 14:22:43.043854 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 14:22:43.043854 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 14:22:43.043854 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 14:22:43.043854 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 14:22:43.043854 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 14:22:43.043854 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 14:22:43.043854 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 14:22:43.043854 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 14:22:43.043854 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 14:22:43.043854 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 14:22:43.043854 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 14:22:43.044694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 14:22:43.044694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 14:22:43.044694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 14:22:43.044694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 14:22:43.044694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 94f910cd-4d09-4ed2-b3f6-4f7b86a7b341 could not be found. Jul 31 14:22:43.044694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:22:43.044694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:22:43.044694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:22:43.044694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:43.044694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:22:43.044694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:22:43.044694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:22:43.044694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:22:43.044694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 14:22:43.044694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 14:22:43.044694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:22:43.044694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:22:43.044694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 31 14:22:43.044694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:22:43.046229 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 94f910cd-4d09-4ed2-b3f6-4f7b86a7b341 could not be found. Jul 31 14:22:43.046229 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:22:43.046229 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:22:43.046229 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:22:43.046229 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:22:43.046229 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:22:43.046229 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:22:43.046229 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:22:43.046229 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:22:43.046229 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 94f910cd-4d09-4ed2-b3f6-4f7b86a7b341 could not be found. Jul 31 14:22:43.046229 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:22:43.046229 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-694b5591-c207-4f18-a6ef-ed1f77f41f70 tempest-VolumesGetTestJSON-1437362591 tempest-VolumesGetTestJSON-1437362591-project] Returning 404 to user: Volume 94f910cd-4d09-4ed2-b3f6-4f7b86a7b341 could not be found. {{(pid=117781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:22:43.046229 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-694b5591-c207-4f18-a6ef-ed1f77f41f70 tempest-VolumesGetTestJSON-1437362591 tempest-VolumesGetTestJSON-1437362591-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/94f910cd-4d09-4ed2-b3f6-4f7b86a7b341" status: 404 len: 109 microversion: 2.1 time: 0.090399 Jul 31 14:22:43.046229 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 4/15] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Jul 31 14:22:42 2022] GET /compute/v2.1/os-volumes/94f910cd-4d09-4ed2-b3f6-4f7b86a7b341 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:22:48.065276 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-175b9beb-a457-4d13-8b09-c7ce01f20dc5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Action: 'create', calling method: .version_select at 0x7f87eb816b80>, body: {"keypair": {"name": "tempest-keypair-684727969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbWjiphblI918RExplqHy9bM7fvDv3ecu7PQrgwvMH4QZEtASfaY2hBmO03DXEsCaYKP+h4hg0KQNyZa9xmEMMLA+JU3L7iSyl28gb48txG7AYGiq20i2AwE0rR7m1SDQ=="}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:22:48.213428 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-175b9beb-a457-4d13-8b09-c7ce01f20dc5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Getting quotas for project 9097fd66951e457ba46812ff17db7501. Resources: {'key_pairs'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:22:48.234266 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-175b9beb-a457-4d13-8b09-c7ce01f20dc5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Getting quotas for user d6e8399080a942f1b689fc8c6b42c717 and project 9097fd66951e457ba46812ff17db7501. Resources: {'key_pairs'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:22:48.359879 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-175b9beb-a457-4d13-8b09-c7ce01f20dc5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.477972 Jul 31 14:22:48.360941 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 12/16] 10.222.0.40 () {60 vars in 1159 bytes} [Sun Jul 31 14:22:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:22:52.782932 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-f0cfac31-9f1f-4f19-9a30-c22ee0018fca tempest-VolumesTestJSON-1013360824 tempest-VolumesTestJSON-1013360824-project] Calling method '.version_select at 0x7f87eb7fc550>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:22:52.908875 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-f0cfac31-9f1f-4f19-9a30-c22ee0018fca tempest-VolumesTestJSON-1013360824 tempest-VolumesTestJSON-1013360824-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/0b52daf5-e013-461c-9d38-cbdd0f65eef4" status: 200 len: 351 microversion: 2.1 time: 0.132918 Jul 31 14:22:52.909683 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 5/17] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Jul 31 14:22:52 2022] GET /compute/v2.1/os-volumes/0b52daf5-e013-461c-9d38-cbdd0f65eef4 => generated 351 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:22:53.284770 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ca7bd89e-74da-49d9-b9a6-7baf65ada06e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-45717903", "imageRef": "57bc051a-64d0-4317-aa93-a7a2aed39369", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cbc0073a-ae55-48a9-8514-9052086eccf8"}], "security_groups": [{"name": "tempest-securitygroup--648086761"}], "key_name": "tempest-keypair-684727969", "user_data": "}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:22:54.266976 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.network.neutron [None req-ca7bd89e-74da-49d9-b9a6-7baf65ada06e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] validate_networks() for [('cbc0073a-ae55-48a9-8514-9052086eccf8', None, None, None, None, None)] {{(pid=117780) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 14:22:54.835549 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-ec11a415-72f9-468a-a4cc-d33c0a9c86bb tempest-VolumesTestJSON-1013360824 tempest-VolumesTestJSON-1013360824-project] Calling method '.version_select at 0x7f87eb7fcc10>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:22:54.934785 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-ec11a415-72f9-468a-a4cc-d33c0a9c86bb tempest-VolumesTestJSON-1013360824 tempest-VolumesTestJSON-1013360824-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/8cc71b7c-f3e6-4357-83ee-d218e1ac92dc" status: 200 len: 350 microversion: 2.1 time: 0.105597 Jul 31 14:22:54.935354 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 6/18] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Jul 31 14:22:54 2022] GET /compute/v2.1/os-volumes/8cc71b7c-f3e6-4357-83ee-d218e1ac92dc => generated 350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:22:56.706442 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-91dfd06b-4d2e-4b9d-b3f3-92ce9653ba90 tempest-VolumesTestJSON-1013360824 tempest-VolumesTestJSON-1013360824-project] Calling method '.version_select at 0x7f87eb9fce50>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:22:56.890169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-91dfd06b-4d2e-4b9d-b3f3-92ce9653ba90 tempest-VolumesTestJSON-1013360824 tempest-VolumesTestJSON-1013360824-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/1a302eb7-259d-4886-a44e-3eb376b46caf" status: 200 len: 350 microversion: 2.1 time: 0.187474 Jul 31 14:22:56.898290 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 7/19] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Jul 31 14:22:56 2022] GET /compute/v2.1/os-volumes/1a302eb7-259d-4886-a44e-3eb376b46caf => generated 350 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:22:56.904534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-810f4734-6555-4a71-a98e-3e63c4a8c224 tempest-VolumesTestJSON-1013360824 tempest-VolumesTestJSON-1013360824-project] Calling method '.version_select at 0x7f87eb7fc820>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:22:57.109674 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-810f4734-6555-4a71-a98e-3e63c4a8c224 tempest-VolumesTestJSON-1013360824 tempest-VolumesTestJSON-1013360824-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.210228 Jul 31 14:22:57.115718 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 8/20] 10.222.0.40 () {58 vars in 1134 bytes} [Sun Jul 31 14:22:56 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:22:57.135191 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-311573c3-8f1f-49b2-aed5-fc6ea952b456 tempest-VolumesTestJSON-1013360824 tempest-VolumesTestJSON-1013360824-project] Calling method '.version_select at 0x7f87eb7f8940>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:22:57.362878 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-311573c3-8f1f-49b2-aed5-fc6ea952b456 tempest-VolumesTestJSON-1013360824 tempest-VolumesTestJSON-1013360824-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.233848 Jul 31 14:22:57.374704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 9/21] 10.222.0.40 () {58 vars in 1149 bytes} [Sun Jul 31 14:22:57 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:22:57.379647 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-d948f375-8457-431c-81fc-69f3ced2d99a tempest-VolumesTestJSON-1013360824 tempest-VolumesTestJSON-1013360824-project] Calling method '.version_select at 0x7f87eb7f88b0>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:22:57.380444 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-ca7bd89e-74da-49d9-b9a6-7baf65ada06e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Flavor limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 14:22:57.381585 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-ca7bd89e-74da-49d9-b9a6-7baf65ada06e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Image limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 14:22:57.382137 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-ca7bd89e-74da-49d9-b9a6-7baf65ada06e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Flavor pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 14:22:57.382693 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-ca7bd89e-74da-49d9-b9a6-7baf65ada06e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Image pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 14:22:57.383536 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-ca7bd89e-74da-49d9-b9a6-7baf65ada06e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 14:22:57.404568 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ca7bd89e-74da-49d9-b9a6-7baf65ada06e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:22:57.413846 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ca7bd89e-74da-49d9-b9a6-7baf65ada06e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:22:57.416652 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ca7bd89e-74da-49d9-b9a6-7baf65ada06e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:22:57.418741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ca7bd89e-74da-49d9-b9a6-7baf65ada06e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:22:57.472418 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-ca7bd89e-74da-49d9-b9a6-7baf65ada06e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Getting quotas for project 9097fd66951e457ba46812ff17db7501. Resources: {'cores', 'ram', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:22:57.480240 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-ca7bd89e-74da-49d9-b9a6-7baf65ada06e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Getting quotas for user d6e8399080a942f1b689fc8c6b42c717 and project 9097fd66951e457ba46812ff17db7501. Resources: {'cores', 'ram', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:22:57.503377 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ca7bd89e-74da-49d9-b9a6-7baf65ada06e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Going to run 1 instances... {{(pid=117780) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 14:22:57.513937 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ca7bd89e-74da-49d9-b9a6-7baf65ada06e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57bc051a-64d0-4317-aa93-a7a2aed39369',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 14:22:57.573879 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-d948f375-8457-431c-81fc-69f3ced2d99a tempest-VolumesTestJSON-1013360824 tempest-VolumesTestJSON-1013360824-project] 10.222.0.40 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.197929 Jul 31 14:22:57.575054 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 10/22] 10.222.0.40 () {58 vars in 1134 bytes} [Sun Jul 31 14:22:57 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:22:57.592044 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-9be000bb-d859-48f4-8522-ef59cf7b60a7 tempest-VolumesTestJSON-1013360824 tempest-VolumesTestJSON-1013360824-project] Calling method '.version_select at 0x7f87eb7fc550>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:22:57.648426 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ca7bd89e-74da-49d9-b9a6-7baf65ada06e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.376793 Jul 31 14:22:57.649719 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 13/23] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Jul 31 14:22:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 4379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 14:22:57.660738 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-48359122-e03e-4d85-8edc-4ec365d854db tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:22:57.661626 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-48359122-e03e-4d85-8edc-4ec365d854db tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:22:57.782043 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-9be000bb-d859-48f4-8522-ef59cf7b60a7 tempest-VolumesTestJSON-1013360824 tempest-VolumesTestJSON-1013360824-project] 10.222.0.40 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.196799 Jul 31 14:22:57.782661 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 11/24] 10.222.0.40 () {58 vars in 1167 bytes} [Sun Jul 31 14:22:57 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:22:57.857584 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-48359122-e03e-4d85-8edc-4ec365d854db tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:22:57.873017 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-48359122-e03e-4d85-8edc-4ec365d854db tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1239 microversion: 2.1 time: 0.216391 Jul 31 14:22:57.889903 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 14/25] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:22:57 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1239 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:22:57.897115 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4a08a8d7-3a0c-4de2-8997-ee84063c824d tempest-VolumesTestJSON-1013360824 tempest-VolumesTestJSON-1013360824-project] Calling method '.version_select at 0x7f87eaebf700>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:22:58.042512 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4a08a8d7-3a0c-4de2-8997-ee84063c824d tempest-VolumesTestJSON-1013360824 tempest-VolumesTestJSON-1013360824-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.151276 Jul 31 14:22:58.043277 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 15/26] 10.222.0.40 () {58 vars in 1170 bytes} [Sun Jul 31 14:22:57 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:22:58.060400 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2056a586-b940-47c8-ad64-27030f7b9222 tempest-VolumesTestJSON-1013360824 tempest-VolumesTestJSON-1013360824-project] Calling method '.version_select at 0x7f87e9e78c10>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:22:58.167534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-9ac296d5-7cb8-4c76-bf2b-d708f86fbf96 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Action: 'create', calling method: .version_select at 0x7f87eb7ff4c0>, body: {"keypair": {"name": "tempest-keypair-1588211006", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNm/GHqMNcyWwvoUu+gT1w4/9XmHafgqtHdUeyTplSNDi4gjgj9W2gLbjJFdYS1pJjBgdGYpjLTZ5xregsuAYATCXkOaP/yN6QBnhIit/9meKZGTP1sAqSqQm0AsC/sqgw=="}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:22:58.235878 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2056a586-b940-47c8-ad64-27030f7b9222 tempest-VolumesTestJSON-1013360824 tempest-VolumesTestJSON-1013360824-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.179857 Jul 31 14:22:58.236697 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 16/27] 10.222.0.40 () {58 vars in 1155 bytes} [Sun Jul 31 14:22:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:22:58.257761 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-be374042-3162-4215-b796-a321786da730 tempest-VolumesTestJSON-1013360824 tempest-VolumesTestJSON-1013360824-project] Calling method '.version_select at 0x7f87e9e88940>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:22:58.356836 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-9ac296d5-7cb8-4c76-bf2b-d708f86fbf96 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Getting quotas for project ae629f9940d446f2ab39e9a49b3f4753. Resources: {'key_pairs'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:22:58.368080 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-9ac296d5-7cb8-4c76-bf2b-d708f86fbf96 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Getting quotas for user 53dab2ec3f2e4973893fb838c3d1d545 and project ae629f9940d446f2ab39e9a49b3f4753. Resources: {'key_pairs'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:22:58.474901 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-be374042-3162-4215-b796-a321786da730 tempest-VolumesTestJSON-1013360824 tempest-VolumesTestJSON-1013360824-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.221857 Jul 31 14:22:58.476210 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 17/28] 10.222.0.40 () {58 vars in 1188 bytes} [Sun Jul 31 14:22:58 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:22:58.490369 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6f147f65-2521-47ef-992d-387535340673 tempest-VolumesTestJSON-1013360824 tempest-VolumesTestJSON-1013360824-project] Calling method '.version_select at 0x7f87e9e8bb80>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:22:58.509507 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-9ac296d5-7cb8-4c76-bf2b-d708f86fbf96 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.725808 Jul 31 14:22:58.515098 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 12/29] 10.222.0.40 () {62 vars in 1200 bytes} [Sun Jul 31 14:22:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 732 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 31 14:22:58.675004 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6f147f65-2521-47ef-992d-387535340673 tempest-VolumesTestJSON-1013360824 tempest-VolumesTestJSON-1013360824-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.189579 Jul 31 14:22:58.675984 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 18/30] 10.222.0.40 () {58 vars in 1155 bytes} [Sun Jul 31 14:22:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:22:58.895090 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-908e0302-b183-4150-b65a-0cd5871164a3 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:22:58.897022 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-908e0302-b183-4150-b65a-0cd5871164a3 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:22:58.970146 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-908e0302-b183-4150-b65a-0cd5871164a3 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:22:58.978510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-908e0302-b183-4150-b65a-0cd5871164a3 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1239 microversion: 2.1 time: 0.088425 Jul 31 14:22:58.979571 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 19/31] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:22:58 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1239 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:22:59.058997 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-3530cee5-61a6-459f-b056-de4884013829 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-586102196", "imageRef": "57bc051a-64d0-4317-aa93-a7a2aed39369", "flavorRef": "452", "networks": [{"uuid": "e9372a5f-4043-4ef0-b455-80de14da5a19"}]}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:22:59.200001 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.network.neutron [None req-3530cee5-61a6-459f-b056-de4884013829 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] validate_networks() for [('e9372a5f-4043-4ef0-b455-80de14da5a19', None, None, None, None, None)] {{(pid=117781) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 14:23:00.172352 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-93d26a85-4cb9-42d7-b877-75517c2786dc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-634110737", "imageRef": "57bc051a-64d0-4317-aa93-a7a2aed39369", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:23:00.311045 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.network.neutron [None req-93d26a85-4cb9-42d7-b877-75517c2786dc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] validate_networks() for [('f5e1ec66-f0ed-4d21-aa4b-ff4b55a9259a', None, None, None, None, None)] {{(pid=117780) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 14:23:01.366983 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-93d26a85-4cb9-42d7-b877-75517c2786dc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Flavor limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 14:23:01.367630 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-93d26a85-4cb9-42d7-b877-75517c2786dc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Image limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 14:23:01.368191 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-93d26a85-4cb9-42d7-b877-75517c2786dc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Flavor pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 14:23:01.368862 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-93d26a85-4cb9-42d7-b877-75517c2786dc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Image pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 14:23:01.369373 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-93d26a85-4cb9-42d7-b877-75517c2786dc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 14:23:01.403601 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-93d26a85-4cb9-42d7-b877-75517c2786dc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:01.405295 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-93d26a85-4cb9-42d7-b877-75517c2786dc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:01.418310 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-93d26a85-4cb9-42d7-b877-75517c2786dc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:01.418858 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-93d26a85-4cb9-42d7-b877-75517c2786dc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:01.471905 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-93d26a85-4cb9-42d7-b877-75517c2786dc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Getting quotas for project 832629dd8594494ab41b6596b2d73076. Resources: {'cores', 'ram', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:23:01.482270 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-93d26a85-4cb9-42d7-b877-75517c2786dc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Getting quotas for user 10a4469c46f64feb819f3b19a0f4e89b and project 832629dd8594494ab41b6596b2d73076. Resources: {'cores', 'ram', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:23:01.525658 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-93d26a85-4cb9-42d7-b877-75517c2786dc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Going to run 1 instances... {{(pid=117780) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 14:23:01.528883 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-93d26a85-4cb9-42d7-b877-75517c2786dc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57bc051a-64d0-4317-aa93-a7a2aed39369',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 14:23:01.606759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-93d26a85-4cb9-42d7-b877-75517c2786dc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.898070 Jul 31 14:23:01.611391 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 20/32] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Jul 31 14:22:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 1903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 14:23:01.623650 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ca99e06b-b8ee-48f0-aba5-a22c6f75f259 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:01.626574 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ca99e06b-b8ee-48f0-aba5-a22c6f75f259 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:01.651297 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ca99e06b-b8ee-48f0-aba5-a22c6f75f259 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:01.655160 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ca99e06b-b8ee-48f0-aba5-a22c6f75f259 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:01.658807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ca99e06b-b8ee-48f0-aba5-a22c6f75f259 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:01.661533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ca99e06b-b8ee-48f0-aba5-a22c6f75f259 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:01.921143 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-3530cee5-61a6-459f-b056-de4884013829 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Flavor limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 14:23:01.922183 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-3530cee5-61a6-459f-b056-de4884013829 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Image limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 14:23:01.922818 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-3530cee5-61a6-459f-b056-de4884013829 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Flavor pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 14:23:01.923367 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-3530cee5-61a6-459f-b056-de4884013829 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Image pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 14:23:01.924063 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-3530cee5-61a6-459f-b056-de4884013829 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 14:23:01.946585 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3530cee5-61a6-459f-b056-de4884013829 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:01.950491 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3530cee5-61a6-459f-b056-de4884013829 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:01.960053 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3530cee5-61a6-459f-b056-de4884013829 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:01.960785 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3530cee5-61a6-459f-b056-de4884013829 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:02.044727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-3530cee5-61a6-459f-b056-de4884013829 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Getting quotas for project f4ef4d34a8114051a67c51e01cb2b8eb. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:23:02.065407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-3530cee5-61a6-459f-b056-de4884013829 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Getting quotas for user db0c001088aa4c86b4562c369deb6c46 and project f4ef4d34a8114051a67c51e01cb2b8eb. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:23:02.102956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-3530cee5-61a6-459f-b056-de4884013829 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Going to run 1 instances... {{(pid=117781) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 14:23:02.105796 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-3530cee5-61a6-459f-b056-de4884013829 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57bc051a-64d0-4317-aa93-a7a2aed39369',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117781) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 14:23:02.368830 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-3530cee5-61a6-459f-b056-de4884013829 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.731427 Jul 31 14:23:02.378920 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 13/33] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Jul 31 14:22:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 14:23:02.392296 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-6e6d5618-dcbf-48fd-9c2e-a92cd2334840 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:02.392927 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-6e6d5618-dcbf-48fd-9c2e-a92cd2334840 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:02.399753 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ca99e06b-b8ee-48f0-aba5-a22c6f75f259 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:02.422060 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ca99e06b-b8ee-48f0-aba5-a22c6f75f259 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1299 microversion: 2.1 time: 0.809262 Jul 31 14:23:02.426287 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 21/34] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:01 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1299 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:02.444801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c2c78d2f-ed66-42f9-8173-811acfd13010 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:02.445640 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c2c78d2f-ed66-42f9-8173-811acfd13010 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:02.625292 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-6e6d5618-dcbf-48fd-9c2e-a92cd2334840 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:02.654650 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-6e6d5618-dcbf-48fd-9c2e-a92cd2334840 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1221 microversion: 2.1 time: 0.274251 Jul 31 14:23:02.657872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c2c78d2f-ed66-42f9-8173-811acfd13010 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:02.658979 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 14/35] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:02 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1221 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:02.670303 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c2c78d2f-ed66-42f9-8173-811acfd13010 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1214 microversion: 2.1 time: 0.238407 Jul 31 14:23:02.689618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 22/36] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:02 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1214 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:03.321531 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-145d5f2b-2d59-4128-90c3-c578806aca02 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1991304177", "imageRef": "57bc051a-64d0-4317-aa93-a7a2aed39369", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:23:03.446440 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9dacf1c1-e903-4067-8ae1-88533493777f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:03.451892 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.network.neutron [None req-145d5f2b-2d59-4128-90c3-c578806aca02 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] validate_networks() for [('f5e1ec66-f0ed-4d21-aa4b-ff4b55a9259a', None, None, None, None, None)] {{(pid=117781) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 14:23:03.452848 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9dacf1c1-e903-4067-8ae1-88533493777f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:03.471113 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9dacf1c1-e903-4067-8ae1-88533493777f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:03.471872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9dacf1c1-e903-4067-8ae1-88533493777f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:03.472832 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9dacf1c1-e903-4067-8ae1-88533493777f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:03.473423 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9dacf1c1-e903-4067-8ae1-88533493777f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:03.621994 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9dacf1c1-e903-4067-8ae1-88533493777f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:03.630789 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9dacf1c1-e903-4067-8ae1-88533493777f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1297 microversion: 2.1 time: 0.188327 Jul 31 14:23:03.635193 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 23/37] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:03 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1297 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:03.697180 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c9308591-0e96-4d32-995e-6e32d901b7f1 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:03.697807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c9308591-0e96-4d32-995e-6e32d901b7f1 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:03.717384 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c9308591-0e96-4d32-995e-6e32d901b7f1 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:03.717853 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c9308591-0e96-4d32-995e-6e32d901b7f1 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:03.718646 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c9308591-0e96-4d32-995e-6e32d901b7f1 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:03.719095 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c9308591-0e96-4d32-995e-6e32d901b7f1 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:03.902009 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c9308591-0e96-4d32-995e-6e32d901b7f1 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:03.910970 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c9308591-0e96-4d32-995e-6e32d901b7f1 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1210 microversion: 2.1 time: 0.218070 Jul 31 14:23:03.915102 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 24/38] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:03 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1210 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:04.229185 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-80db7673-9f8a-443f-8d22-5fd8a8188987 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-245897115", "imageRef": "57bc051a-64d0-4317-aa93-a7a2aed39369", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b6a43aa-cc11-41ae-aa14-00f6b134f366"}], "security_groups": [{"name": "tempest-securitygroup--2005376969"}], "key_name": "tempest-keypair-1588211006", "user_data": "}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:23:04.523762 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.network.neutron [None req-80db7673-9f8a-443f-8d22-5fd8a8188987 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] validate_networks() for [('6b6a43aa-cc11-41ae-aa14-00f6b134f366', None, None, None, None, None)] {{(pid=117780) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 14:23:05.886734 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-145d5f2b-2d59-4128-90c3-c578806aca02 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Flavor limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 14:23:05.887700 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-145d5f2b-2d59-4128-90c3-c578806aca02 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Image limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 14:23:05.888550 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-145d5f2b-2d59-4128-90c3-c578806aca02 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Flavor pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 14:23:05.889281 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-145d5f2b-2d59-4128-90c3-c578806aca02 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Image pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 14:23:05.889851 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-145d5f2b-2d59-4128-90c3-c578806aca02 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 14:23:05.922895 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-145d5f2b-2d59-4128-90c3-c578806aca02 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:05.929185 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-145d5f2b-2d59-4128-90c3-c578806aca02 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:05.937385 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-145d5f2b-2d59-4128-90c3-c578806aca02 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:05.940673 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-145d5f2b-2d59-4128-90c3-c578806aca02 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:06.079126 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-145d5f2b-2d59-4128-90c3-c578806aca02 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Getting quotas for project 832629dd8594494ab41b6596b2d73076. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:23:06.108004 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-145d5f2b-2d59-4128-90c3-c578806aca02 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Getting quotas for user 10a4469c46f64feb819f3b19a0f4e89b and project 832629dd8594494ab41b6596b2d73076. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:23:06.200699 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-145d5f2b-2d59-4128-90c3-c578806aca02 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Going to run 1 instances... {{(pid=117781) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 14:23:06.203247 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-145d5f2b-2d59-4128-90c3-c578806aca02 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57bc051a-64d0-4317-aa93-a7a2aed39369',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117781) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 14:23:06.395136 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-145d5f2b-2d59-4128-90c3-c578806aca02 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.078325 Jul 31 14:23:06.406660 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 15/39] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Jul 31 14:23:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 3090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 14:23:06.423800 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-389cd7af-8fac-4667-8438-6836375a1436 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:06.426087 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-389cd7af-8fac-4667-8438-6836375a1436 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:06.448515 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-389cd7af-8fac-4667-8438-6836375a1436 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:06.448985 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-389cd7af-8fac-4667-8438-6836375a1436 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:06.450041 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-389cd7af-8fac-4667-8438-6836375a1436 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:06.450489 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-389cd7af-8fac-4667-8438-6836375a1436 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:07.140478 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-80db7673-9f8a-443f-8d22-5fd8a8188987 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Flavor limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 14:23:07.144176 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-80db7673-9f8a-443f-8d22-5fd8a8188987 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Image limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 14:23:07.144176 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-80db7673-9f8a-443f-8d22-5fd8a8188987 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Flavor pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 14:23:07.144176 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-80db7673-9f8a-443f-8d22-5fd8a8188987 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Image pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 14:23:07.144971 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-80db7673-9f8a-443f-8d22-5fd8a8188987 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 14:23:07.163792 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-80db7673-9f8a-443f-8d22-5fd8a8188987 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:07.171200 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-80db7673-9f8a-443f-8d22-5fd8a8188987 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:07.173987 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-80db7673-9f8a-443f-8d22-5fd8a8188987 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:07.175370 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-80db7673-9f8a-443f-8d22-5fd8a8188987 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:07.246946 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-80db7673-9f8a-443f-8d22-5fd8a8188987 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Getting quotas for project ae629f9940d446f2ab39e9a49b3f4753. Resources: {'cores', 'ram', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:23:07.263617 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-80db7673-9f8a-443f-8d22-5fd8a8188987 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Getting quotas for user 53dab2ec3f2e4973893fb838c3d1d545 and project ae629f9940d446f2ab39e9a49b3f4753. Resources: {'cores', 'ram', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:23:07.317879 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-80db7673-9f8a-443f-8d22-5fd8a8188987 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Going to run 1 instances... {{(pid=117780) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 14:23:07.326433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-80db7673-9f8a-443f-8d22-5fd8a8188987 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57bc051a-64d0-4317-aa93-a7a2aed39369',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 14:23:07.492875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-80db7673-9f8a-443f-8d22-5fd8a8188987 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.267990 Jul 31 14:23:07.506666 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 25/40] 10.222.0.40 () {62 vars in 1188 bytes} [Sun Jul 31 14:23:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 3281 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 31 14:23:07.519113 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1b00cbc1-d625-432a-9e53-42ee647fee79 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:07.520256 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1b00cbc1-d625-432a-9e53-42ee647fee79 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:07.548540 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1b00cbc1-d625-432a-9e53-42ee647fee79 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:07.549682 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1b00cbc1-d625-432a-9e53-42ee647fee79 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:07.563894 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1b00cbc1-d625-432a-9e53-42ee647fee79 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:07.565061 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1b00cbc1-d625-432a-9e53-42ee647fee79 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:07.949266 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1b00cbc1-d625-432a-9e53-42ee647fee79 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:07.957522 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1b00cbc1-d625-432a-9e53-42ee647fee79 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1272 microversion: 2.1 time: 0.449240 Jul 31 14:23:07.958100 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 26/41] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:07 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1272 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:07.992312 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-de98507a-2f97-4532-9631-117948558f6a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:07.992966 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-de98507a-2f97-4532-9631-117948558f6a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:08.037953 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-de98507a-2f97-4532-9631-117948558f6a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:08.038528 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-de98507a-2f97-4532-9631-117948558f6a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:08.039359 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-de98507a-2f97-4532-9631-117948558f6a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:08.046089 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-de98507a-2f97-4532-9631-117948558f6a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:08.479379 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-de98507a-2f97-4532-9631-117948558f6a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:08.488503 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-de98507a-2f97-4532-9631-117948558f6a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1226 microversion: 2.1 time: 0.523614 Jul 31 14:23:08.489099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 27/42] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:07 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1226 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:08.538786 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-814079d5-0b73-499f-8bbb-3e706682411d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:08.545323 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-814079d5-0b73-499f-8bbb-3e706682411d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:08.938775 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-814079d5-0b73-499f-8bbb-3e706682411d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:08.948968 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-814079d5-0b73-499f-8bbb-3e706682411d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:08.950880 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-814079d5-0b73-499f-8bbb-3e706682411d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:08.952054 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-814079d5-0b73-499f-8bbb-3e706682411d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1281 microversion: 2.20 time: 0.450804 Jul 31 14:23:08.973592 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 28/43] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:23:08 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1281 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:23:08.987745 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0566f0b5-c7d8-42e5-afe1-5e33f232fc3d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:08.988636 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0566f0b5-c7d8-42e5-afe1-5e33f232fc3d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:09.001528 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0566f0b5-c7d8-42e5-afe1-5e33f232fc3d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:09.002243 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0566f0b5-c7d8-42e5-afe1-5e33f232fc3d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:09.006224 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0566f0b5-c7d8-42e5-afe1-5e33f232fc3d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:09.006847 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0566f0b5-c7d8-42e5-afe1-5e33f232fc3d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:09.139871 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-389cd7af-8fac-4667-8438-6836375a1436 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:09.184473 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-389cd7af-8fac-4667-8438-6836375a1436 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1364 microversion: 2.1 time: 2.776240 Jul 31 14:23:09.190035 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 16/44] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:06 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1364 bytes in 2781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:09.461727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0566f0b5-c7d8-42e5-afe1-5e33f232fc3d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:09.485295 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0566f0b5-c7d8-42e5-afe1-5e33f232fc3d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1272 microversion: 2.1 time: 0.510282 Jul 31 14:23:09.485954 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 29/45] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:08 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1272 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:09.515520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-4787ba2b-4737-4ff1-9363-650d382cc7b0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:09.516651 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-4787ba2b-4737-4ff1-9363-650d382cc7b0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:09.550301 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4787ba2b-4737-4ff1-9363-650d382cc7b0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:09.555135 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4787ba2b-4737-4ff1-9363-650d382cc7b0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:09.564638 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4787ba2b-4737-4ff1-9363-650d382cc7b0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:09.565952 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4787ba2b-4737-4ff1-9363-650d382cc7b0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:09.926291 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-4787ba2b-4737-4ff1-9363-650d382cc7b0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:09.939646 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-4787ba2b-4737-4ff1-9363-650d382cc7b0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1282 microversion: 2.1 time: 0.430161 Jul 31 14:23:09.946253 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 17/46] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:09 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1282 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:09.981482 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-77fedb23-bf49-4dd5-913c-091008817ae5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:09.982216 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-77fedb23-bf49-4dd5-913c-091008817ae5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:10.007247 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-77fedb23-bf49-4dd5-913c-091008817ae5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:10.010749 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-77fedb23-bf49-4dd5-913c-091008817ae5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:10.014131 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-77fedb23-bf49-4dd5-913c-091008817ae5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:10.016131 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-77fedb23-bf49-4dd5-913c-091008817ae5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:10.209588 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-89302f7d-e29f-4a36-b185-53551c7bd904 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:10.211110 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-89302f7d-e29f-4a36-b185-53551c7bd904 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:10.232498 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-89302f7d-e29f-4a36-b185-53551c7bd904 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:10.233497 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-89302f7d-e29f-4a36-b185-53551c7bd904 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:10.234517 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-89302f7d-e29f-4a36-b185-53551c7bd904 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:10.235117 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-89302f7d-e29f-4a36-b185-53551c7bd904 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:10.484630 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-77fedb23-bf49-4dd5-913c-091008817ae5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:10.506613 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-77fedb23-bf49-4dd5-913c-091008817ae5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:10.508361 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-77fedb23-bf49-4dd5-913c-091008817ae5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:10.524255 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-77fedb23-bf49-4dd5-913c-091008817ae5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1277 microversion: 2.20 time: 0.547723 Jul 31 14:23:10.528468 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 30/47] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:23:09 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1277 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:23:10.554063 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4793739c-5faa-4172-adb7-e06c2b0e714e tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:10.554790 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4793739c-5faa-4172-adb7-e06c2b0e714e tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:10.579586 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4793739c-5faa-4172-adb7-e06c2b0e714e tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:10.580132 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4793739c-5faa-4172-adb7-e06c2b0e714e tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:10.588918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4793739c-5faa-4172-adb7-e06c2b0e714e tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:10.589567 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4793739c-5faa-4172-adb7-e06c2b0e714e tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:10.847791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4793739c-5faa-4172-adb7-e06c2b0e714e tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:10.864049 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4793739c-5faa-4172-adb7-e06c2b0e714e tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1272 microversion: 2.1 time: 0.334409 Jul 31 14:23:10.865447 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 31/48] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:10 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1272 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:10.971699 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-44f02b71-4b90-4cc1-b18f-c23bb952276f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:10.972825 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-44f02b71-4b90-4cc1-b18f-c23bb952276f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:10.987489 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-44f02b71-4b90-4cc1-b18f-c23bb952276f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:10.988480 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-44f02b71-4b90-4cc1-b18f-c23bb952276f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:10.990366 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-44f02b71-4b90-4cc1-b18f-c23bb952276f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:10.991088 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-44f02b71-4b90-4cc1-b18f-c23bb952276f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:11.276959 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-44f02b71-4b90-4cc1-b18f-c23bb952276f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:11.300565 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-44f02b71-4b90-4cc1-b18f-c23bb952276f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1280 microversion: 2.1 time: 0.333048 Jul 31 14:23:11.303920 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 32/49] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:10 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1280 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:11.321736 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-89302f7d-e29f-4a36-b185-53551c7bd904 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:11.334290 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-89302f7d-e29f-4a36-b185-53551c7bd904 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1364 microversion: 2.1 time: 1.128519 Jul 31 14:23:11.343991 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 18/50] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:10 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1364 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:11.572656 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-95818b8d-424f-4b5b-b56a-118ed307731b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:11.573394 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-95818b8d-424f-4b5b-b56a-118ed307731b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:11.583907 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:23:11.603163 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-95818b8d-424f-4b5b-b56a-118ed307731b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:11.615615 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-95818b8d-424f-4b5b-b56a-118ed307731b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:11.623688 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-95818b8d-424f-4b5b-b56a-118ed307731b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:11.623688 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-95818b8d-424f-4b5b-b56a-118ed307731b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:11.887804 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-22d560e4-36ca-4458-8202-6c7e2ff64c0d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:11.888793 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-22d560e4-36ca-4458-8202-6c7e2ff64c0d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:11.898444 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-22d560e4-36ca-4458-8202-6c7e2ff64c0d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:11.899136 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-22d560e4-36ca-4458-8202-6c7e2ff64c0d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:11.901059 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-22d560e4-36ca-4458-8202-6c7e2ff64c0d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:11.903561 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-22d560e4-36ca-4458-8202-6c7e2ff64c0d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:11.999909 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-95818b8d-424f-4b5b-b56a-118ed307731b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:12.009323 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-95818b8d-424f-4b5b-b56a-118ed307731b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:12.019968 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-95818b8d-424f-4b5b-b56a-118ed307731b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:12.022270 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-95818b8d-424f-4b5b-b56a-118ed307731b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1351 microversion: 2.20 time: 0.471320 Jul 31 14:23:12.044451 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 33/51] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:23:11 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1351 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:23:12.223326 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-22d560e4-36ca-4458-8202-6c7e2ff64c0d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:12.238673 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-22d560e4-36ca-4458-8202-6c7e2ff64c0d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1272 microversion: 2.1 time: 0.355185 Jul 31 14:23:12.240826 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 19/52] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:11 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1272 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:12.329588 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7715e743-154c-4645-9f85-08018e3e2dfe tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:12.330366 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7715e743-154c-4645-9f85-08018e3e2dfe tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:12.342954 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7715e743-154c-4645-9f85-08018e3e2dfe tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:12.344871 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7715e743-154c-4645-9f85-08018e3e2dfe tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:12.346508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7715e743-154c-4645-9f85-08018e3e2dfe tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:12.348549 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7715e743-154c-4645-9f85-08018e3e2dfe tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:12.365438 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-19169fbb-64fd-46e0-af30-74fac0f8173a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:12.366084 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-19169fbb-64fd-46e0-af30-74fac0f8173a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:12.385559 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-19169fbb-64fd-46e0-af30-74fac0f8173a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:12.388233 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-19169fbb-64fd-46e0-af30-74fac0f8173a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:12.393360 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-19169fbb-64fd-46e0-af30-74fac0f8173a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:12.394553 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-19169fbb-64fd-46e0-af30-74fac0f8173a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:12.605382 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7715e743-154c-4645-9f85-08018e3e2dfe tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:12.619548 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7715e743-154c-4645-9f85-08018e3e2dfe tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1280 microversion: 2.1 time: 0.292702 Jul 31 14:23:12.633160 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 34/53] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:12 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1280 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:13.058233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7da44eb4-e4ab-47a4-9207-da7ad5201ba6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:13.059086 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7da44eb4-e4ab-47a4-9207-da7ad5201ba6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:13.075191 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7da44eb4-e4ab-47a4-9207-da7ad5201ba6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:13.077892 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7da44eb4-e4ab-47a4-9207-da7ad5201ba6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:13.079716 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7da44eb4-e4ab-47a4-9207-da7ad5201ba6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:13.080168 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7da44eb4-e4ab-47a4-9207-da7ad5201ba6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:13.461955 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7da44eb4-e4ab-47a4-9207-da7ad5201ba6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:13.475898 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7da44eb4-e4ab-47a4-9207-da7ad5201ba6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:13.480029 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7da44eb4-e4ab-47a4-9207-da7ad5201ba6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:13.481223 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7da44eb4-e4ab-47a4-9207-da7ad5201ba6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1339 microversion: 2.20 time: 0.427535 Jul 31 14:23:13.485532 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 35/54] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:23:13 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1339 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:23:13.504356 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d33f54a2-4097-450e-941d-e5621d5b1b9f tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:13.505549 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d33f54a2-4097-450e-941d-e5621d5b1b9f tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:13.519305 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d33f54a2-4097-450e-941d-e5621d5b1b9f tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:13.521937 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d33f54a2-4097-450e-941d-e5621d5b1b9f tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:13.527626 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d33f54a2-4097-450e-941d-e5621d5b1b9f tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:13.528327 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d33f54a2-4097-450e-941d-e5621d5b1b9f tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:14.152160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-19169fbb-64fd-46e0-af30-74fac0f8173a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:14.163275 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-19169fbb-64fd-46e0-af30-74fac0f8173a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1364 microversion: 2.1 time: 1.802383 Jul 31 14:23:14.167982 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 20/55] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:12 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1364 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:14.172665 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-74ef2334-9ddb-4d44-b5fa-2afd335bbcae tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:14.173277 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-74ef2334-9ddb-4d44-b5fa-2afd335bbcae tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:14.216089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-74ef2334-9ddb-4d44-b5fa-2afd335bbcae tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:14.216567 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-74ef2334-9ddb-4d44-b5fa-2afd335bbcae tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:14.217410 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-74ef2334-9ddb-4d44-b5fa-2afd335bbcae tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:14.217823 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-74ef2334-9ddb-4d44-b5fa-2afd335bbcae tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:14.659129 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-74ef2334-9ddb-4d44-b5fa-2afd335bbcae tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:14.675066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-74ef2334-9ddb-4d44-b5fa-2afd335bbcae tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1280 microversion: 2.1 time: 0.505986 Jul 31 14:23:14.691735 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 21/56] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:14 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1280 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:14.714083 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b9589fa4-ad1a-4b7c-b8b1-7d85c278f14a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:14.714962 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b9589fa4-ad1a-4b7c-b8b1-7d85c278f14a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:14.731380 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d33f54a2-4097-450e-941d-e5621d5b1b9f tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:14.738553 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b9589fa4-ad1a-4b7c-b8b1-7d85c278f14a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:14.744468 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b9589fa4-ad1a-4b7c-b8b1-7d85c278f14a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:14.746123 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d33f54a2-4097-450e-941d-e5621d5b1b9f tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1314 microversion: 2.1 time: 1.257249 Jul 31 14:23:14.747505 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b9589fa4-ad1a-4b7c-b8b1-7d85c278f14a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:14.748215 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b9589fa4-ad1a-4b7c-b8b1-7d85c278f14a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:14.751772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 36/57] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:13 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1314 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:15.168576 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-973dbc80-74b5-40d9-a131-997ca4b349b1 req-dc173b91-0b55-4ce6-98ae-69aff81b0f1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4f24854-1bcd-405b-9af8-fd3f3967d16b", "tag": "21edb8cd-f77a-499c-afac-f0de24050b9d"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:23:15.220986 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-973dbc80-74b5-40d9-a131-997ca4b349b1 req-dc173b91-0b55-4ce6-98ae-69aff81b0f1a service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:15.223691 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-973dbc80-74b5-40d9-a131-997ca4b349b1 req-dc173b91-0b55-4ce6-98ae-69aff81b0f1a service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:15.316378 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-973dbc80-74b5-40d9-a131-997ca4b349b1 req-dc173b91-0b55-4ce6-98ae-69aff81b0f1a service nova] Creating event network-changed:21edb8cd-f77a-499c-afac-f0de24050b9d for instance e4f24854-1bcd-405b-9af8-fd3f3967d16b on hv-cinder-84984 Jul 31 14:23:15.317238 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-973dbc80-74b5-40d9-a131-997ca4b349b1 req-dc173b91-0b55-4ce6-98ae-69aff81b0f1a service nova] Acquired lock "compute-rpcapi-router" {{(pid=117780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 31 14:23:15.320744 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-78abedea-b2d2-46b1-95bf-18623469c338 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:15.321195 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-78abedea-b2d2-46b1-95bf-18623469c338 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:15.324223 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-78abedea-b2d2-46b1-95bf-18623469c338 None None] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:15.325396 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-78abedea-b2d2-46b1-95bf-18623469c338 None None] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:15.370734 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.compute.rpcapi [None req-78abedea-b2d2-46b1-95bf-18623469c338 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 31 14:23:15.373114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-78abedea-b2d2-46b1-95bf-18623469c338 None None] Releasing lock "compute-rpcapi-router" {{(pid=117780) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 31 14:23:15.426723 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-78abedea-b2d2-46b1-95bf-18623469c338 None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.411811 Jul 31 14:23:15.428352 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 37/58] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:23:15.445159 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e33b44c3-fd8a-444e-a81f-19a9e39f6920 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:15.447450 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e33b44c3-fd8a-444e-a81f-19a9e39f6920 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:15.468940 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e33b44c3-fd8a-444e-a81f-19a9e39f6920 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:15.471349 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e33b44c3-fd8a-444e-a81f-19a9e39f6920 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:15.472312 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e33b44c3-fd8a-444e-a81f-19a9e39f6920 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:15.474601 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e33b44c3-fd8a-444e-a81f-19a9e39f6920 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:15.779729 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b9589fa4-ad1a-4b7c-b8b1-7d85c278f14a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:15.794280 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b9589fa4-ad1a-4b7c-b8b1-7d85c278f14a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:15.798827 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b9589fa4-ad1a-4b7c-b8b1-7d85c278f14a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:15.800090 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b9589fa4-ad1a-4b7c-b8b1-7d85c278f14a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1407 microversion: 2.20 time: 1.107051 Jul 31 14:23:15.803199 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 22/59] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:23:14 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1407 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:23:15.811203 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-8bbb5bf7-e67d-4d0e-9d11-c8aec6abc192 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:15.811858 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-8bbb5bf7-e67d-4d0e-9d11-c8aec6abc192 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:15.827348 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8bbb5bf7-e67d-4d0e-9d11-c8aec6abc192 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:15.830137 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8bbb5bf7-e67d-4d0e-9d11-c8aec6abc192 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:15.830964 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8bbb5bf7-e67d-4d0e-9d11-c8aec6abc192 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:15.831402 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8bbb5bf7-e67d-4d0e-9d11-c8aec6abc192 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:15.945400 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-8bbb5bf7-e67d-4d0e-9d11-c8aec6abc192 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:15.961587 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-8bbb5bf7-e67d-4d0e-9d11-c8aec6abc192 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1280 microversion: 2.1 time: 0.157229 Jul 31 14:23:15.962829 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 23/60] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:15 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1280 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:15.968553 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b60326c1-95ac-478c-bc23-9a57430f0f16 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:15.969171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b60326c1-95ac-478c-bc23-9a57430f0f16 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:15.986288 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b60326c1-95ac-478c-bc23-9a57430f0f16 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:15.986802 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b60326c1-95ac-478c-bc23-9a57430f0f16 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:15.987616 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b60326c1-95ac-478c-bc23-9a57430f0f16 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:15.995311 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b60326c1-95ac-478c-bc23-9a57430f0f16 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:15.996022 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=4 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:23:16.175131 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=18 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:23:16.313257 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e33b44c3-fd8a-444e-a81f-19a9e39f6920 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:16.324022 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e33b44c3-fd8a-444e-a81f-19a9e39f6920 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1364 microversion: 2.1 time: 0.894068 Jul 31 14:23:16.324980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 38/61] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:15 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1364 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:16.542959 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b60326c1-95ac-478c-bc23-9a57430f0f16 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:16.554815 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b60326c1-95ac-478c-bc23-9a57430f0f16 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1314 microversion: 2.1 time: 0.590503 Jul 31 14:23:16.558088 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 24/62] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:15 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:16.832424 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e072d104-6520-492d-9589-a29ed34e10e5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:16.836970 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e072d104-6520-492d-9589-a29ed34e10e5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:16.883321 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e072d104-6520-492d-9589-a29ed34e10e5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:16.889237 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e072d104-6520-492d-9589-a29ed34e10e5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:16.890165 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e072d104-6520-492d-9589-a29ed34e10e5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:16.893272 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e072d104-6520-492d-9589-a29ed34e10e5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:16.986184 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-3cd5f0a5-918d-4b32-b9f4-fa7682ebb88a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:16.986920 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-3cd5f0a5-918d-4b32-b9f4-fa7682ebb88a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:16.997998 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3cd5f0a5-918d-4b32-b9f4-fa7682ebb88a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:17.005802 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3cd5f0a5-918d-4b32-b9f4-fa7682ebb88a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:17.008375 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3cd5f0a5-918d-4b32-b9f4-fa7682ebb88a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:17.009004 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3cd5f0a5-918d-4b32-b9f4-fa7682ebb88a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:17.530463 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e072d104-6520-492d-9589-a29ed34e10e5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:17.534132 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=100 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:23:17.556416 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e072d104-6520-492d-9589-a29ed34e10e5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:17.562402 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e072d104-6520-492d-9589-a29ed34e10e5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:17.567365 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e072d104-6520-492d-9589-a29ed34e10e5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1407 microversion: 2.20 time: 0.741832 Jul 31 14:23:17.576661 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 39/63] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:23:16 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1407 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:23:17.581556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-846eb8ae-ceb9-46be-b99c-49667acec7e6 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:17.582163 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-846eb8ae-ceb9-46be-b99c-49667acec7e6 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:17.624811 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-846eb8ae-ceb9-46be-b99c-49667acec7e6 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:17.625362 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-846eb8ae-ceb9-46be-b99c-49667acec7e6 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:17.627390 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-846eb8ae-ceb9-46be-b99c-49667acec7e6 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:17.631748 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-846eb8ae-ceb9-46be-b99c-49667acec7e6 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:18.329297 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-3cd5f0a5-918d-4b32-b9f4-fa7682ebb88a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:18.339688 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-3cd5f0a5-918d-4b32-b9f4-fa7682ebb88a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1322 microversion: 2.1 time: 1.357471 Jul 31 14:23:18.340284 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 25/64] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:16 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1322 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:18.365394 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-38a0841e-c4ec-4ee4-a5dd-04f2c080bfb3 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:18.366343 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-38a0841e-c4ec-4ee4-a5dd-04f2c080bfb3 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:18.376374 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-38a0841e-c4ec-4ee4-a5dd-04f2c080bfb3 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:18.377091 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-38a0841e-c4ec-4ee4-a5dd-04f2c080bfb3 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:18.378504 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-38a0841e-c4ec-4ee4-a5dd-04f2c080bfb3 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:18.379809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-38a0841e-c4ec-4ee4-a5dd-04f2c080bfb3 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:18.785325 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-38a0841e-c4ec-4ee4-a5dd-04f2c080bfb3 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:18.797639 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-38a0841e-c4ec-4ee4-a5dd-04f2c080bfb3 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1314 microversion: 2.1 time: 0.451776 Jul 31 14:23:18.801485 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 26/65] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:18 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:18.830099 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-60326821-38d3-4452-b37d-68afdb2bdd92 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:18.831604 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-60326821-38d3-4452-b37d-68afdb2bdd92 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:18.846998 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-60326821-38d3-4452-b37d-68afdb2bdd92 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:18.849580 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-60326821-38d3-4452-b37d-68afdb2bdd92 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:18.850871 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-60326821-38d3-4452-b37d-68afdb2bdd92 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:18.855237 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-60326821-38d3-4452-b37d-68afdb2bdd92 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:18.915570 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-846eb8ae-ceb9-46be-b99c-49667acec7e6 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:18.927142 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-846eb8ae-ceb9-46be-b99c-49667acec7e6 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1364 microversion: 2.1 time: 1.349200 Jul 31 14:23:18.928374 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 40/66] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:17 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1364 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:18.933442 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-054e0477-590a-4e34-972b-32ef9a051480 req-7e3931ef-3a48-4356-9bbe-92788efe7f62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c15a0e90-90b9-47be-a034-3de7757c7bcb", "tag": "4e3565ba-9723-4b87-a1a4-bbb331da879d"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:23:18.949990 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=30 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:23:18.961277 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-054e0477-590a-4e34-972b-32ef9a051480 req-7e3931ef-3a48-4356-9bbe-92788efe7f62 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:18.962103 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-054e0477-590a-4e34-972b-32ef9a051480 req-7e3931ef-3a48-4356-9bbe-92788efe7f62 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:18.986587 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-054e0477-590a-4e34-972b-32ef9a051480 req-7e3931ef-3a48-4356-9bbe-92788efe7f62 service nova] Creating event network-changed:4e3565ba-9723-4b87-a1a4-bbb331da879d for instance c15a0e90-90b9-47be-a034-3de7757c7bcb on hv-cinder-84984 Jul 31 14:23:18.998964 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-054e0477-590a-4e34-972b-32ef9a051480 req-7e3931ef-3a48-4356-9bbe-92788efe7f62 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068846 Jul 31 14:23:18.999816 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 41/67] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:23:19.076482 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-60326821-38d3-4452-b37d-68afdb2bdd92 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:19.087387 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-60326821-38d3-4452-b37d-68afdb2bdd92 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:19.088995 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-60326821-38d3-4452-b37d-68afdb2bdd92 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:19.090451 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-60326821-38d3-4452-b37d-68afdb2bdd92 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1407 microversion: 2.20 time: 0.271111 Jul 31 14:23:19.091032 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 27/68] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:23:18 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:23:19.381623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9df2805e-dee5-4691-9183-10c8e4c028b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:19.382779 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9df2805e-dee5-4691-9183-10c8e4c028b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:19.389213 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9df2805e-dee5-4691-9183-10c8e4c028b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:19.389659 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9df2805e-dee5-4691-9183-10c8e4c028b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:19.390426 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9df2805e-dee5-4691-9183-10c8e4c028b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:19.391279 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9df2805e-dee5-4691-9183-10c8e4c028b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:19.731411 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9df2805e-dee5-4691-9183-10c8e4c028b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:19.740702 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9df2805e-dee5-4691-9183-10c8e4c028b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1322 microversion: 2.1 time: 0.379642 Jul 31 14:23:19.743171 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 42/69] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:19 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1322 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:19.821937 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-765cf63b-6c10-434f-9213-5e31f7f8fd1f tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:19.822619 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-765cf63b-6c10-434f-9213-5e31f7f8fd1f tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:19.829377 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-765cf63b-6c10-434f-9213-5e31f7f8fd1f tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:19.829863 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-765cf63b-6c10-434f-9213-5e31f7f8fd1f tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:19.830624 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-765cf63b-6c10-434f-9213-5e31f7f8fd1f tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:19.844148 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-765cf63b-6c10-434f-9213-5e31f7f8fd1f tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:19.860022 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-54588be4-fb6e-4a9b-81bd-111bfb428b08 req-f4bbbfff-8184-478e-9232-18a1eb895a52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0810b36-49ee-482b-9e65-f587148b2a81", "tag": "24bdbc3b-fa2f-407d-8ddb-f37abeee2dba"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:23:19.889306 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-54588be4-fb6e-4a9b-81bd-111bfb428b08 req-f4bbbfff-8184-478e-9232-18a1eb895a52 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:19.889748 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-54588be4-fb6e-4a9b-81bd-111bfb428b08 req-f4bbbfff-8184-478e-9232-18a1eb895a52 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:19.934333 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-54588be4-fb6e-4a9b-81bd-111bfb428b08 req-f4bbbfff-8184-478e-9232-18a1eb895a52 service nova] Creating event network-changed:24bdbc3b-fa2f-407d-8ddb-f37abeee2dba for instance d0810b36-49ee-482b-9e65-f587148b2a81 on hv-cinder-84984 Jul 31 14:23:19.938017 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-54588be4-fb6e-4a9b-81bd-111bfb428b08 req-f4bbbfff-8184-478e-9232-18a1eb895a52 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117781) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 31 14:23:19.939408 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-527f4b56-e86a-4022-a343-3700f2e2e72c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:19.940075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-527f4b56-e86a-4022-a343-3700f2e2e72c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:19.941926 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-527f4b56-e86a-4022-a343-3700f2e2e72c None None] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:19.943161 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-527f4b56-e86a-4022-a343-3700f2e2e72c None None] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:19.954926 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.compute.rpcapi [None req-527f4b56-e86a-4022-a343-3700f2e2e72c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 31 14:23:19.955968 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-527f4b56-e86a-4022-a343-3700f2e2e72c None None] Releasing lock "compute-rpcapi-router" {{(pid=117781) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 31 14:23:19.991407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-527f4b56-e86a-4022-a343-3700f2e2e72c None None] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.219960 Jul 31 14:23:19.996004 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 28/70] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:23:20.005078 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-bc2e9242-50e8-42a5-b868-f8ca891e0965 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:20.011560 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-bc2e9242-50e8-42a5-b868-f8ca891e0965 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:20.018609 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bc2e9242-50e8-42a5-b868-f8ca891e0965 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:20.018985 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bc2e9242-50e8-42a5-b868-f8ca891e0965 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:20.020024 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bc2e9242-50e8-42a5-b868-f8ca891e0965 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:20.021147 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bc2e9242-50e8-42a5-b868-f8ca891e0965 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:20.038915 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-765cf63b-6c10-434f-9213-5e31f7f8fd1f tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:20.047366 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-765cf63b-6c10-434f-9213-5e31f7f8fd1f tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1314 microversion: 2.1 time: 0.229321 Jul 31 14:23:20.058987 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 43/71] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:19 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:20.119651 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f0610c4b-f0a5-4a97-884b-a65666564dd6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:20.119651 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f0610c4b-f0a5-4a97-884b-a65666564dd6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:20.124735 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0610c4b-f0a5-4a97-884b-a65666564dd6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:20.125520 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0610c4b-f0a5-4a97-884b-a65666564dd6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:20.127299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0610c4b-f0a5-4a97-884b-a65666564dd6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:20.127897 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0610c4b-f0a5-4a97-884b-a65666564dd6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:20.231266 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-bc2e9242-50e8-42a5-b868-f8ca891e0965 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:20.240179 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-bc2e9242-50e8-42a5-b868-f8ca891e0965 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1364 microversion: 2.1 time: 0.242605 Jul 31 14:23:20.255930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 29/72] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:19 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1364 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:20.307153 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f0610c4b-f0a5-4a97-884b-a65666564dd6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:20.316247 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f0610c4b-f0a5-4a97-884b-a65666564dd6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:20.318425 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f0610c4b-f0a5-4a97-884b-a65666564dd6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:20.319893 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f0610c4b-f0a5-4a97-884b-a65666564dd6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1407 microversion: 2.20 time: 0.209035 Jul 31 14:23:20.320282 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 44/73] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:23:20 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:23:20.763653 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-0b796858-138e-4ec9-9e73-d93322608ea3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:20.764267 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-0b796858-138e-4ec9-9e73-d93322608ea3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:20.770184 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0b796858-138e-4ec9-9e73-d93322608ea3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:20.770643 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0b796858-138e-4ec9-9e73-d93322608ea3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:20.771391 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0b796858-138e-4ec9-9e73-d93322608ea3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:20.771847 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0b796858-138e-4ec9-9e73-d93322608ea3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:20.898285 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-0b796858-138e-4ec9-9e73-d93322608ea3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:20.905693 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-0b796858-138e-4ec9-9e73-d93322608ea3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1322 microversion: 2.1 time: 0.145978 Jul 31 14:23:20.906263 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 30/74] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:20 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:21.014185 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-bd364951-97e8-43c2-85d2-86c71dddbd53 req-879a0c79-1cd6-4948-877c-32fef826b971 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "712880e4-54c2-4ea2-b932-a8ff5efa0966", "tag": "fd1b1c90-9fee-4c88-917b-cd367e44842e"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:23:21.024210 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-bd364951-97e8-43c2-85d2-86c71dddbd53 req-879a0c79-1cd6-4948-877c-32fef826b971 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:21.024649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-bd364951-97e8-43c2-85d2-86c71dddbd53 req-879a0c79-1cd6-4948-877c-32fef826b971 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:21.035064 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-bd364951-97e8-43c2-85d2-86c71dddbd53 req-879a0c79-1cd6-4948-877c-32fef826b971 service nova] Creating event network-changed:fd1b1c90-9fee-4c88-917b-cd367e44842e for instance 712880e4-54c2-4ea2-b932-a8ff5efa0966 on hv-cinder-84984 Jul 31 14:23:21.039749 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-bd364951-97e8-43c2-85d2-86c71dddbd53 req-879a0c79-1cd6-4948-877c-32fef826b971 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029182 Jul 31 14:23:21.040553 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 45/75] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:23:21.068926 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-76d46110-4da5-403c-a11f-fd15231002c7 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:21.069535 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-76d46110-4da5-403c-a11f-fd15231002c7 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:21.076423 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-76d46110-4da5-403c-a11f-fd15231002c7 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:21.076916 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-76d46110-4da5-403c-a11f-fd15231002c7 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:21.077887 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-76d46110-4da5-403c-a11f-fd15231002c7 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:21.078329 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-76d46110-4da5-403c-a11f-fd15231002c7 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:21.212828 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-76d46110-4da5-403c-a11f-fd15231002c7 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:21.220556 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-76d46110-4da5-403c-a11f-fd15231002c7 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1314 microversion: 2.1 time: 0.155972 Jul 31 14:23:21.221132 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 31/76] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:21 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:21.262886 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b4eebc1f-d8e4-422b-b080-98c41f3f3855 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:21.263601 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b4eebc1f-d8e4-422b-b080-98c41f3f3855 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:21.269845 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b4eebc1f-d8e4-422b-b080-98c41f3f3855 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:21.270284 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b4eebc1f-d8e4-422b-b080-98c41f3f3855 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:21.271107 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b4eebc1f-d8e4-422b-b080-98c41f3f3855 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:21.271565 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b4eebc1f-d8e4-422b-b080-98c41f3f3855 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:21.344120 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-1f747a84-7637-4aed-9b2c-8c8ae2d0e8f4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:21.344842 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-1f747a84-7637-4aed-9b2c-8c8ae2d0e8f4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:21.351541 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1f747a84-7637-4aed-9b2c-8c8ae2d0e8f4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:21.352073 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1f747a84-7637-4aed-9b2c-8c8ae2d0e8f4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:21.352919 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1f747a84-7637-4aed-9b2c-8c8ae2d0e8f4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:21.353363 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1f747a84-7637-4aed-9b2c-8c8ae2d0e8f4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:21.357546 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=100 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:23:21.415029 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b4eebc1f-d8e4-422b-b080-98c41f3f3855 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:21.423105 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b4eebc1f-d8e4-422b-b080-98c41f3f3855 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1364 microversion: 2.1 time: 0.164225 Jul 31 14:23:21.435888 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 46/77] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:21 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:21.519026 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-1f747a84-7637-4aed-9b2c-8c8ae2d0e8f4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:21.538307 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-1f747a84-7637-4aed-9b2c-8c8ae2d0e8f4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:21.540109 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-1f747a84-7637-4aed-9b2c-8c8ae2d0e8f4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:21.541255 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-1f747a84-7637-4aed-9b2c-8c8ae2d0e8f4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1407 microversion: 2.20 time: 0.201066 Jul 31 14:23:21.541811 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 32/78] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:23:21 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:23:21.926361 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4ffa45fd-91b7-4160-802b-f8bec80e6f2a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:21.927387 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4ffa45fd-91b7-4160-802b-f8bec80e6f2a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:21.935942 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4ffa45fd-91b7-4160-802b-f8bec80e6f2a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:21.936711 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4ffa45fd-91b7-4160-802b-f8bec80e6f2a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:21.938010 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4ffa45fd-91b7-4160-802b-f8bec80e6f2a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:21.938640 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4ffa45fd-91b7-4160-802b-f8bec80e6f2a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:22.017205 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-171696ce-c47d-4ac1-97a7-6d8ce3c0e57e req-c275ec92-3122-4e2d-8edc-24788d70eac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b525f36f-61be-4205-85c9-112378b82b28", "tag": "ed70b0fd-9fe3-4da7-820f-d863fbfcf92e"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:23:22.027258 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-171696ce-c47d-4ac1-97a7-6d8ce3c0e57e req-c275ec92-3122-4e2d-8edc-24788d70eac0 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:22.028060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-171696ce-c47d-4ac1-97a7-6d8ce3c0e57e req-c275ec92-3122-4e2d-8edc-24788d70eac0 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:22.040868 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-171696ce-c47d-4ac1-97a7-6d8ce3c0e57e req-c275ec92-3122-4e2d-8edc-24788d70eac0 service nova] Creating event network-changed:ed70b0fd-9fe3-4da7-820f-d863fbfcf92e for instance b525f36f-61be-4205-85c9-112378b82b28 on hv-cinder-84984 Jul 31 14:23:22.045845 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-171696ce-c47d-4ac1-97a7-6d8ce3c0e57e req-c275ec92-3122-4e2d-8edc-24788d70eac0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032261 Jul 31 14:23:22.046444 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 33/79] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:23:22.169117 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4ffa45fd-91b7-4160-802b-f8bec80e6f2a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:22.176526 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4ffa45fd-91b7-4160-802b-f8bec80e6f2a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1322 microversion: 2.1 time: 0.254245 Jul 31 14:23:22.177085 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 47/80] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:21 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:22.245340 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-5ad7dd38-86b2-4ecb-b51a-ab9dbd89bc11 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:22.246116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-5ad7dd38-86b2-4ecb-b51a-ab9dbd89bc11 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:22.252352 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5ad7dd38-86b2-4ecb-b51a-ab9dbd89bc11 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:22.252798 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5ad7dd38-86b2-4ecb-b51a-ab9dbd89bc11 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:22.253550 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5ad7dd38-86b2-4ecb-b51a-ab9dbd89bc11 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:22.253981 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5ad7dd38-86b2-4ecb-b51a-ab9dbd89bc11 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:22.383920 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-5ad7dd38-86b2-4ecb-b51a-ab9dbd89bc11 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:22.391252 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-5ad7dd38-86b2-4ecb-b51a-ab9dbd89bc11 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1314 microversion: 2.1 time: 0.150423 Jul 31 14:23:22.391848 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 34/81] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:22 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:22.444605 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-572bb4d4-6162-458b-9cae-9e56ab7bf8fd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:22.445336 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-572bb4d4-6162-458b-9cae-9e56ab7bf8fd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:22.451767 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-572bb4d4-6162-458b-9cae-9e56ab7bf8fd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:22.452216 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-572bb4d4-6162-458b-9cae-9e56ab7bf8fd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:22.452980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-572bb4d4-6162-458b-9cae-9e56ab7bf8fd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:22.453416 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-572bb4d4-6162-458b-9cae-9e56ab7bf8fd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:22.565815 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-5bebf1c9-eba3-4ba8-8d01-d1c91a38014a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:22.566423 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-5bebf1c9-eba3-4ba8-8d01-d1c91a38014a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:22.577664 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5bebf1c9-eba3-4ba8-8d01-d1c91a38014a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:22.578313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5bebf1c9-eba3-4ba8-8d01-d1c91a38014a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:22.579252 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5bebf1c9-eba3-4ba8-8d01-d1c91a38014a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:22.579853 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5bebf1c9-eba3-4ba8-8d01-d1c91a38014a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:22.599364 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-572bb4d4-6162-458b-9cae-9e56ab7bf8fd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:22.608157 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-572bb4d4-6162-458b-9cae-9e56ab7bf8fd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1364 microversion: 2.1 time: 0.167790 Jul 31 14:23:22.608748 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 48/82] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:22 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:22.743912 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-5bebf1c9-eba3-4ba8-8d01-d1c91a38014a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:22.756820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-5bebf1c9-eba3-4ba8-8d01-d1c91a38014a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:22.759027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-5bebf1c9-eba3-4ba8-8d01-d1c91a38014a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:22.760693 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-5bebf1c9-eba3-4ba8-8d01-d1c91a38014a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1407 microversion: 2.20 time: 0.199783 Jul 31 14:23:22.762027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 35/83] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:23:22 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:23:23.199046 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fd801695-c744-4347-a696-5dd61bacfd20 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:23.200785 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fd801695-c744-4347-a696-5dd61bacfd20 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:23.238149 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd801695-c744-4347-a696-5dd61bacfd20 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:23.239006 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd801695-c744-4347-a696-5dd61bacfd20 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:23.243033 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd801695-c744-4347-a696-5dd61bacfd20 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:23.243529 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd801695-c744-4347-a696-5dd61bacfd20 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:23.415466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-8e374180-4fd3-42d7-ad34-6b5b8f5a3434 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:23.416938 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-8e374180-4fd3-42d7-ad34-6b5b8f5a3434 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:23.424461 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:23:23.427481 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8e374180-4fd3-42d7-ad34-6b5b8f5a3434 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:23.428378 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8e374180-4fd3-42d7-ad34-6b5b8f5a3434 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:23.429495 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8e374180-4fd3-42d7-ad34-6b5b8f5a3434 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:23.430163 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8e374180-4fd3-42d7-ad34-6b5b8f5a3434 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:23.739855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fd801695-c744-4347-a696-5dd61bacfd20 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:23.789330 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fd801695-c744-4347-a696-5dd61bacfd20 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1322 microversion: 2.1 time: 0.595749 Jul 31 14:23:23.790579 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 49/84] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:23 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1322 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:23.799528 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3b871c0e-1e6a-4dfb-b41c-ffe82904c964 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:23.800871 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3b871c0e-1e6a-4dfb-b41c-ffe82904c964 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:23.827568 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3b871c0e-1e6a-4dfb-b41c-ffe82904c964 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:23.828164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3b871c0e-1e6a-4dfb-b41c-ffe82904c964 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:23.829137 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3b871c0e-1e6a-4dfb-b41c-ffe82904c964 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:23.829833 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3b871c0e-1e6a-4dfb-b41c-ffe82904c964 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:23.856661 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-8e374180-4fd3-42d7-ad34-6b5b8f5a3434 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:23.865581 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-8e374180-4fd3-42d7-ad34-6b5b8f5a3434 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1314 microversion: 2.1 time: 0.456584 Jul 31 14:23:23.866741 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 36/85] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:23 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:23.872371 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-9ab46bf1-7269-4cd6-a7f6-d68952470824 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:23.873124 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-9ab46bf1-7269-4cd6-a7f6-d68952470824 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:23.885092 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9ab46bf1-7269-4cd6-a7f6-d68952470824 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:23.885873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9ab46bf1-7269-4cd6-a7f6-d68952470824 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:23.886827 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9ab46bf1-7269-4cd6-a7f6-d68952470824 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:23.887599 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9ab46bf1-7269-4cd6-a7f6-d68952470824 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:24.015827 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3b871c0e-1e6a-4dfb-b41c-ffe82904c964 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:24.024786 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3b871c0e-1e6a-4dfb-b41c-ffe82904c964 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1364 microversion: 2.1 time: 0.231835 Jul 31 14:23:24.025618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 50/86] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:23 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:24.196387 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-9ab46bf1-7269-4cd6-a7f6-d68952470824 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:24.209637 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-9ab46bf1-7269-4cd6-a7f6-d68952470824 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:24.211544 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-9ab46bf1-7269-4cd6-a7f6-d68952470824 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:24.212895 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-9ab46bf1-7269-4cd6-a7f6-d68952470824 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1407 microversion: 2.20 time: 0.344680 Jul 31 14:23:24.213630 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 37/87] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:23:23 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1407 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:23:24.809840 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-68a92944-050a-42d1-9783-2267e33c3662 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:24.810449 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-68a92944-050a-42d1-9783-2267e33c3662 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:24.816303 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-68a92944-050a-42d1-9783-2267e33c3662 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:24.816750 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-68a92944-050a-42d1-9783-2267e33c3662 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:24.817501 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-68a92944-050a-42d1-9783-2267e33c3662 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:24.817941 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-68a92944-050a-42d1-9783-2267e33c3662 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:24.886236 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-33be1a04-12dd-44b8-b93d-df1ae5acde6b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:24.886847 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-33be1a04-12dd-44b8-b93d-df1ae5acde6b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:24.892971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-33be1a04-12dd-44b8-b93d-df1ae5acde6b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:24.893421 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-33be1a04-12dd-44b8-b93d-df1ae5acde6b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:24.894190 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-33be1a04-12dd-44b8-b93d-df1ae5acde6b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:24.894632 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-33be1a04-12dd-44b8-b93d-df1ae5acde6b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:25.002007 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-68a92944-050a-42d1-9783-2267e33c3662 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:25.009991 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-68a92944-050a-42d1-9783-2267e33c3662 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1322 microversion: 2.1 time: 0.203925 Jul 31 14:23:25.010570 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 51/88] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:24 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:25.032128 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-33be1a04-12dd-44b8-b93d-df1ae5acde6b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:25.040267 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-33be1a04-12dd-44b8-b93d-df1ae5acde6b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1314 microversion: 2.1 time: 0.157834 Jul 31 14:23:25.053947 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ae18cc95-80b1-437d-a8fd-6e7a2195c73f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:25.054561 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ae18cc95-80b1-437d-a8fd-6e7a2195c73f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:25.057638 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 38/89] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:24 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:25.060736 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ae18cc95-80b1-437d-a8fd-6e7a2195c73f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:25.061181 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ae18cc95-80b1-437d-a8fd-6e7a2195c73f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:25.061938 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ae18cc95-80b1-437d-a8fd-6e7a2195c73f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:25.062364 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ae18cc95-80b1-437d-a8fd-6e7a2195c73f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:25.195241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ae18cc95-80b1-437d-a8fd-6e7a2195c73f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:25.203039 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ae18cc95-80b1-437d-a8fd-6e7a2195c73f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1364 microversion: 2.1 time: 0.161062 Jul 31 14:23:25.203633 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 52/90] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:25 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:25.235190 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-f77953f2-fcad-4383-8f67-8ab61bf37a38 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:25.235826 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-f77953f2-fcad-4383-8f67-8ab61bf37a38 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:25.242184 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f77953f2-fcad-4383-8f67-8ab61bf37a38 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:25.242637 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f77953f2-fcad-4383-8f67-8ab61bf37a38 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:25.243401 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f77953f2-fcad-4383-8f67-8ab61bf37a38 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:25.243868 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f77953f2-fcad-4383-8f67-8ab61bf37a38 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:25.382267 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-f77953f2-fcad-4383-8f67-8ab61bf37a38 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:25.391688 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-f77953f2-fcad-4383-8f67-8ab61bf37a38 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:25.393221 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-f77953f2-fcad-4383-8f67-8ab61bf37a38 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:25.394441 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-f77953f2-fcad-4383-8f67-8ab61bf37a38 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1407 microversion: 2.20 time: 0.163113 Jul 31 14:23:25.394993 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 39/91] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:23:25 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:23:26.030949 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0511aa66-07ce-4142-8ecc-d84b425e6689 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:26.031606 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0511aa66-07ce-4142-8ecc-d84b425e6689 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:26.033668 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=8 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:23:26.039122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0511aa66-07ce-4142-8ecc-d84b425e6689 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:26.039516 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0511aa66-07ce-4142-8ecc-d84b425e6689 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:26.040285 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0511aa66-07ce-4142-8ecc-d84b425e6689 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:26.040718 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0511aa66-07ce-4142-8ecc-d84b425e6689 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:26.061850 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-fc4a8c0c-98fa-4ec2-9d71-85fd3b9f50b2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:26.062595 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-fc4a8c0c-98fa-4ec2-9d71-85fd3b9f50b2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:26.070542 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fc4a8c0c-98fa-4ec2-9d71-85fd3b9f50b2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:26.071215 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fc4a8c0c-98fa-4ec2-9d71-85fd3b9f50b2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:26.072787 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fc4a8c0c-98fa-4ec2-9d71-85fd3b9f50b2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:26.073325 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fc4a8c0c-98fa-4ec2-9d71-85fd3b9f50b2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:26.193642 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0511aa66-07ce-4142-8ecc-d84b425e6689 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:26.202317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0511aa66-07ce-4142-8ecc-d84b425e6689 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1322 microversion: 2.1 time: 0.175364 Jul 31 14:23:26.203126 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 53/92] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:26 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:26.228177 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d89c1e02-1166-453e-8c11-4e043d989692 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:26.228782 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d89c1e02-1166-453e-8c11-4e043d989692 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:26.228878 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-fc4a8c0c-98fa-4ec2-9d71-85fd3b9f50b2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:26.236151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d89c1e02-1166-453e-8c11-4e043d989692 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:26.236600 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d89c1e02-1166-453e-8c11-4e043d989692 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:26.236772 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-fc4a8c0c-98fa-4ec2-9d71-85fd3b9f50b2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1314 microversion: 2.1 time: 0.179584 Jul 31 14:23:26.237368 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d89c1e02-1166-453e-8c11-4e043d989692 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:26.237704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 40/93] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:26 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:26.239743 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d89c1e02-1166-453e-8c11-4e043d989692 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:26.418951 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-10fc69b8-d97f-48b7-a674-d103d6d59d02 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:26.419606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-10fc69b8-d97f-48b7-a674-d103d6d59d02 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:26.437365 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-10fc69b8-d97f-48b7-a674-d103d6d59d02 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:26.437735 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-10fc69b8-d97f-48b7-a674-d103d6d59d02 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:26.438539 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-10fc69b8-d97f-48b7-a674-d103d6d59d02 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:26.438964 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-10fc69b8-d97f-48b7-a674-d103d6d59d02 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:26.671820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-10fc69b8-d97f-48b7-a674-d103d6d59d02 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:26.680925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d89c1e02-1166-453e-8c11-4e043d989692 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:26.685792 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-10fc69b8-d97f-48b7-a674-d103d6d59d02 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:26.691319 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-10fc69b8-d97f-48b7-a674-d103d6d59d02 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:26.695083 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-10fc69b8-d97f-48b7-a674-d103d6d59d02 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1407 microversion: 2.20 time: 0.281290 Jul 31 14:23:26.696739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d89c1e02-1166-453e-8c11-4e043d989692 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1364 microversion: 2.1 time: 0.472231 Jul 31 14:23:26.698375 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 54/94] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:26 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1364 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:26.713113 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 41/95] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:23:26 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1407 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:23:27.223515 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e7e7d89b-9616-4547-900a-d03e7f0aa3dd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:27.224127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e7e7d89b-9616-4547-900a-d03e7f0aa3dd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:27.230074 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e7e7d89b-9616-4547-900a-d03e7f0aa3dd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:27.230527 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e7e7d89b-9616-4547-900a-d03e7f0aa3dd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:27.231325 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e7e7d89b-9616-4547-900a-d03e7f0aa3dd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:27.231823 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e7e7d89b-9616-4547-900a-d03e7f0aa3dd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:27.258586 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-eabf8eb3-abac-424b-911f-d71a3a0f877a tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:27.259211 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-eabf8eb3-abac-424b-911f-d71a3a0f877a tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:27.265254 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eabf8eb3-abac-424b-911f-d71a3a0f877a tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:27.265694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eabf8eb3-abac-424b-911f-d71a3a0f877a tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:27.266649 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eabf8eb3-abac-424b-911f-d71a3a0f877a tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:27.267224 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eabf8eb3-abac-424b-911f-d71a3a0f877a tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:27.383494 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e7e7d89b-9616-4547-900a-d03e7f0aa3dd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:27.391849 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e7e7d89b-9616-4547-900a-d03e7f0aa3dd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1322 microversion: 2.1 time: 0.172125 Jul 31 14:23:27.392920 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 55/96] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:27 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:27.434028 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-eabf8eb3-abac-424b-911f-d71a3a0f877a tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:27.443158 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-eabf8eb3-abac-424b-911f-d71a3a0f877a tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1314 microversion: 2.1 time: 0.189237 Jul 31 14:23:27.443804 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 42/97] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:27 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:27.723216 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-975abb23-eed0-4750-8969-5a15a16e74b2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:27.724487 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-aaaa278d-012f-4fba-89f9-48c3f5612ac5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:27.725280 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-aaaa278d-012f-4fba-89f9-48c3f5612ac5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:27.725657 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-975abb23-eed0-4750-8969-5a15a16e74b2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:27.732653 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aaaa278d-012f-4fba-89f9-48c3f5612ac5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:27.733274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aaaa278d-012f-4fba-89f9-48c3f5612ac5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:27.734205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aaaa278d-012f-4fba-89f9-48c3f5612ac5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:27.734533 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-975abb23-eed0-4750-8969-5a15a16e74b2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:27.735235 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aaaa278d-012f-4fba-89f9-48c3f5612ac5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:27.735630 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-975abb23-eed0-4750-8969-5a15a16e74b2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:27.736609 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-975abb23-eed0-4750-8969-5a15a16e74b2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:27.737250 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-975abb23-eed0-4750-8969-5a15a16e74b2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:27.913794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-975abb23-eed0-4750-8969-5a15a16e74b2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:27.923706 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-975abb23-eed0-4750-8969-5a15a16e74b2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:27.925469 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-975abb23-eed0-4750-8969-5a15a16e74b2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:27.927611 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-975abb23-eed0-4750-8969-5a15a16e74b2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1407 microversion: 2.20 time: 0.208526 Jul 31 14:23:27.928341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 43/98] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:23:27 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:23:27.932742 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-aaaa278d-012f-4fba-89f9-48c3f5612ac5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:27.941486 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-aaaa278d-012f-4fba-89f9-48c3f5612ac5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1364 microversion: 2.1 time: 0.223342 Jul 31 14:23:27.942792 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 56/99] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:27 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:28.412571 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b7b27037-3fb2-4adb-a1a0-d1d77c095958 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:28.413181 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b7b27037-3fb2-4adb-a1a0-d1d77c095958 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:28.419259 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b7b27037-3fb2-4adb-a1a0-d1d77c095958 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:28.419744 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b7b27037-3fb2-4adb-a1a0-d1d77c095958 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:28.420509 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b7b27037-3fb2-4adb-a1a0-d1d77c095958 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:28.421119 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b7b27037-3fb2-4adb-a1a0-d1d77c095958 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:28.463808 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3fa6cfca-fb5e-4082-b6cb-1200528f4b5b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:28.466039 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3fa6cfca-fb5e-4082-b6cb-1200528f4b5b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:28.477511 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3fa6cfca-fb5e-4082-b6cb-1200528f4b5b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:28.478392 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3fa6cfca-fb5e-4082-b6cb-1200528f4b5b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:28.479489 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3fa6cfca-fb5e-4082-b6cb-1200528f4b5b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:28.480455 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3fa6cfca-fb5e-4082-b6cb-1200528f4b5b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:28.778627 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3fa6cfca-fb5e-4082-b6cb-1200528f4b5b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:28.783654 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=100 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:23:28.790001 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3fa6cfca-fb5e-4082-b6cb-1200528f4b5b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1314 microversion: 2.1 time: 0.330422 Jul 31 14:23:28.793855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 57/100] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:28 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:28.851781 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b7b27037-3fb2-4adb-a1a0-d1d77c095958 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:28.869203 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b7b27037-3fb2-4adb-a1a0-d1d77c095958 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1322 microversion: 2.1 time: 0.460996 Jul 31 14:23:28.886687 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 44/101] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:28 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1322 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:28.952390 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0a666b89-f852-485a-86ae-6284da3784ab tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:28.953083 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0a666b89-f852-485a-86ae-6284da3784ab tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:28.960481 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0a666b89-f852-485a-86ae-6284da3784ab tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:28.961156 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0a666b89-f852-485a-86ae-6284da3784ab tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:28.962137 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0a666b89-f852-485a-86ae-6284da3784ab tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:28.962758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0a666b89-f852-485a-86ae-6284da3784ab tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:28.966145 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-677f6179-d7d1-4ee3-a141-abcc601fb0d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:28.967869 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-677f6179-d7d1-4ee3-a141-abcc601fb0d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:28.987349 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-677f6179-d7d1-4ee3-a141-abcc601fb0d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:28.988015 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-677f6179-d7d1-4ee3-a141-abcc601fb0d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:28.989075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-677f6179-d7d1-4ee3-a141-abcc601fb0d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:28.991076 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-677f6179-d7d1-4ee3-a141-abcc601fb0d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:29.530676 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-677f6179-d7d1-4ee3-a141-abcc601fb0d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:29.548095 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-677f6179-d7d1-4ee3-a141-abcc601fb0d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1364 microversion: 2.1 time: 0.588041 Jul 31 14:23:29.548746 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 45/102] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:28 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1364 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:29.660474 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0a666b89-f852-485a-86ae-6284da3784ab tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:29.669991 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0a666b89-f852-485a-86ae-6284da3784ab tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:29.679393 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0a666b89-f852-485a-86ae-6284da3784ab tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:29.680906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0a666b89-f852-485a-86ae-6284da3784ab tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1407 microversion: 2.20 time: 0.733931 Jul 31 14:23:29.691824 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 58/103] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:23:28 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1407 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:23:29.813563 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-ab518d62-c314-4b2a-acf0-1bb1f7ad6f6d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:29.814339 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-ab518d62-c314-4b2a-acf0-1bb1f7ad6f6d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:29.825088 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ab518d62-c314-4b2a-acf0-1bb1f7ad6f6d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:29.828808 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ab518d62-c314-4b2a-acf0-1bb1f7ad6f6d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:29.829932 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ab518d62-c314-4b2a-acf0-1bb1f7ad6f6d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:29.830932 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ab518d62-c314-4b2a-acf0-1bb1f7ad6f6d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:29.892595 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d0db98ca-5488-438d-ad08-a4e04f9f03fc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:29.893577 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d0db98ca-5488-438d-ad08-a4e04f9f03fc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:29.907803 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d0db98ca-5488-438d-ad08-a4e04f9f03fc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:29.913155 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d0db98ca-5488-438d-ad08-a4e04f9f03fc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:29.916374 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d0db98ca-5488-438d-ad08-a4e04f9f03fc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:29.918989 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d0db98ca-5488-438d-ad08-a4e04f9f03fc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:29.952824 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:23:30.065364 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-ab518d62-c314-4b2a-acf0-1bb1f7ad6f6d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:30.075833 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-ab518d62-c314-4b2a-acf0-1bb1f7ad6f6d tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1314 microversion: 2.1 time: 0.266926 Jul 31 14:23:30.077227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 46/104] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:29 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:30.143089 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d0db98ca-5488-438d-ad08-a4e04f9f03fc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:30.155394 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d0db98ca-5488-438d-ad08-a4e04f9f03fc tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1322 microversion: 2.1 time: 0.267146 Jul 31 14:23:30.159691 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-7b8148f3-dab9-4de9-894f-6d359be3eb46 req-59619957-51b9-4b88-9b78-bf0485ce53c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4f24854-1bcd-405b-9af8-fd3f3967d16b", "name": "network-vif-plugged", "status": "completed", "tag": "21edb8cd-f77a-499c-afac-f0de24050b9d"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:23:30.160619 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 59/105] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:29 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:30.184078 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-7b8148f3-dab9-4de9-894f-6d359be3eb46 req-59619957-51b9-4b88-9b78-bf0485ce53c6 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:30.184805 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-7b8148f3-dab9-4de9-894f-6d359be3eb46 req-59619957-51b9-4b88-9b78-bf0485ce53c6 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:30.197697 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-7b8148f3-dab9-4de9-894f-6d359be3eb46 req-59619957-51b9-4b88-9b78-bf0485ce53c6 service nova] Creating event network-vif-plugged:21edb8cd-f77a-499c-afac-f0de24050b9d for instance e4f24854-1bcd-405b-9af8-fd3f3967d16b on hv-cinder-84984 Jul 31 14:23:30.204262 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-7b8148f3-dab9-4de9-894f-6d359be3eb46 req-59619957-51b9-4b88-9b78-bf0485ce53c6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117972 Jul 31 14:23:30.209822 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 47/106] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:23:30.571107 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8637f69d-c7ab-4ed2-b868-7ff00e379054 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:30.571851 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8637f69d-c7ab-4ed2-b868-7ff00e379054 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:30.580242 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8637f69d-c7ab-4ed2-b868-7ff00e379054 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:30.580684 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8637f69d-c7ab-4ed2-b868-7ff00e379054 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:30.581832 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8637f69d-c7ab-4ed2-b868-7ff00e379054 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:30.582581 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8637f69d-c7ab-4ed2-b868-7ff00e379054 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:30.707659 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-e3b560af-2931-465e-8840-b5e68c2d37c8 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:30.708915 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-e3b560af-2931-465e-8840-b5e68c2d37c8 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:30.720382 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e3b560af-2931-465e-8840-b5e68c2d37c8 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:30.720843 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e3b560af-2931-465e-8840-b5e68c2d37c8 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:30.721630 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e3b560af-2931-465e-8840-b5e68c2d37c8 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:30.722072 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e3b560af-2931-465e-8840-b5e68c2d37c8 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:30.748173 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8637f69d-c7ab-4ed2-b868-7ff00e379054 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:30.772283 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8637f69d-c7ab-4ed2-b868-7ff00e379054 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1364 microversion: 2.1 time: 0.205468 Jul 31 14:23:30.773675 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 60/107] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:30 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1364 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:30.897702 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e3b560af-2931-465e-8840-b5e68c2d37c8 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:30.906806 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e3b560af-2931-465e-8840-b5e68c2d37c8 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:30.908620 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e3b560af-2931-465e-8840-b5e68c2d37c8 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:30.909979 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-e3b560af-2931-465e-8840-b5e68c2d37c8 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1407 microversion: 2.20 time: 0.207922 Jul 31 14:23:30.919447 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 48/108] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:23:30 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:23:31.100301 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3de76090-cbc7-4b2e-9f7c-d68ccfdfd8bb tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:31.101254 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3de76090-cbc7-4b2e-9f7c-d68ccfdfd8bb tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:31.109509 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3de76090-cbc7-4b2e-9f7c-d68ccfdfd8bb tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:31.110293 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3de76090-cbc7-4b2e-9f7c-d68ccfdfd8bb tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:31.111631 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3de76090-cbc7-4b2e-9f7c-d68ccfdfd8bb tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:31.112360 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3de76090-cbc7-4b2e-9f7c-d68ccfdfd8bb tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:31.181506 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-9dc58c2b-3177-40b6-803b-50ef33140a43 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:31.184675 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-9dc58c2b-3177-40b6-803b-50ef33140a43 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:31.197195 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9dc58c2b-3177-40b6-803b-50ef33140a43 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:31.200166 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9dc58c2b-3177-40b6-803b-50ef33140a43 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:31.202446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9dc58c2b-3177-40b6-803b-50ef33140a43 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:31.203019 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9dc58c2b-3177-40b6-803b-50ef33140a43 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:31.350265 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3de76090-cbc7-4b2e-9f7c-d68ccfdfd8bb tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:31.362014 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3de76090-cbc7-4b2e-9f7c-d68ccfdfd8bb tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1314 microversion: 2.1 time: 0.266393 Jul 31 14:23:31.377105 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 61/109] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:31 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:31.521226 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-9dc58c2b-3177-40b6-803b-50ef33140a43 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:31.529420 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-9dc58c2b-3177-40b6-803b-50ef33140a43 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1322 microversion: 2.1 time: 0.353205 Jul 31 14:23:31.532027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 49/110] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:31 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:31.793752 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-79216b71-5cdd-4c91-a898-076936dc57bb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:31.794370 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-79216b71-5cdd-4c91-a898-076936dc57bb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:31.813192 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-79216b71-5cdd-4c91-a898-076936dc57bb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:31.814243 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-79216b71-5cdd-4c91-a898-076936dc57bb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:31.815174 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-79216b71-5cdd-4c91-a898-076936dc57bb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:31.815779 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-79216b71-5cdd-4c91-a898-076936dc57bb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:31.935558 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-d9cb0c56-8c1a-4d44-9681-9567e678fb7b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:31.936157 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-d9cb0c56-8c1a-4d44-9681-9567e678fb7b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:31.956707 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d9cb0c56-8c1a-4d44-9681-9567e678fb7b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:31.957168 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d9cb0c56-8c1a-4d44-9681-9567e678fb7b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:31.958491 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d9cb0c56-8c1a-4d44-9681-9567e678fb7b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:31.958932 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d9cb0c56-8c1a-4d44-9681-9567e678fb7b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:31.977920 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=100 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:23:32.193019 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-79216b71-5cdd-4c91-a898-076936dc57bb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:32.204890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-79216b71-5cdd-4c91-a898-076936dc57bb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1364 microversion: 2.1 time: 0.412525 Jul 31 14:23:32.210211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 62/111] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:31 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1364 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:32.240007 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-d9cb0c56-8c1a-4d44-9681-9567e678fb7b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:32.251635 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-d9cb0c56-8c1a-4d44-9681-9567e678fb7b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:32.252637 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-d9cb0c56-8c1a-4d44-9681-9567e678fb7b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:32.253994 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-d9cb0c56-8c1a-4d44-9681-9567e678fb7b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1407 microversion: 2.20 time: 0.322453 Jul 31 14:23:32.255998 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 50/112] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:23:31 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1407 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:23:32.290070 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-c828be8d-a205-4ab6-9116-849ef16ce735 req-1ae7d45a-52fe-4e73-8f83-850788f70b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b525f36f-61be-4205-85c9-112378b82b28", "name": "network-vif-plugged", "status": "completed", "tag": "ed70b0fd-9fe3-4da7-820f-d863fbfcf92e"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:23:32.311412 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-c828be8d-a205-4ab6-9116-849ef16ce735 req-1ae7d45a-52fe-4e73-8f83-850788f70b29 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:32.313453 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-c828be8d-a205-4ab6-9116-849ef16ce735 req-1ae7d45a-52fe-4e73-8f83-850788f70b29 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:32.354437 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-c828be8d-a205-4ab6-9116-849ef16ce735 req-1ae7d45a-52fe-4e73-8f83-850788f70b29 service nova] Creating event network-vif-plugged:ed70b0fd-9fe3-4da7-820f-d863fbfcf92e for instance b525f36f-61be-4205-85c9-112378b82b28 on hv-cinder-84984 Jul 31 14:23:32.385963 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-fb4a3de4-1c0c-4ebd-bdf6-525661de0cca tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:32.386589 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-fb4a3de4-1c0c-4ebd-bdf6-525661de0cca tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:32.402550 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-c828be8d-a205-4ab6-9116-849ef16ce735 req-1ae7d45a-52fe-4e73-8f83-850788f70b29 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118086 Jul 31 14:23:32.403714 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 63/113] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:23:32.403831 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fb4a3de4-1c0c-4ebd-bdf6-525661de0cca tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:32.404708 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fb4a3de4-1c0c-4ebd-bdf6-525661de0cca tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:32.407123 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fb4a3de4-1c0c-4ebd-bdf6-525661de0cca tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:32.407961 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fb4a3de4-1c0c-4ebd-bdf6-525661de0cca tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:32.584998 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b316da17-930c-4d64-8268-b22568607e8e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:32.587387 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b316da17-930c-4d64-8268-b22568607e8e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:32.605432 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b316da17-930c-4d64-8268-b22568607e8e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:32.608723 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b316da17-930c-4d64-8268-b22568607e8e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:32.609934 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b316da17-930c-4d64-8268-b22568607e8e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:32.612600 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b316da17-930c-4d64-8268-b22568607e8e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:32.844638 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b316da17-930c-4d64-8268-b22568607e8e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:32.854180 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b316da17-930c-4d64-8268-b22568607e8e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1322 microversion: 2.1 time: 0.299344 Jul 31 14:23:32.867448 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 64/114] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:32 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:32.921833 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-fb4a3de4-1c0c-4ebd-bdf6-525661de0cca tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:32.931891 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-fb4a3de4-1c0c-4ebd-bdf6-525661de0cca tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1314 microversion: 2.1 time: 0.551583 Jul 31 14:23:32.932673 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 51/115] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:32 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:33.230629 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2e2dc0be-8891-4581-83b3-d4dc043c1bbd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:33.231625 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2e2dc0be-8891-4581-83b3-d4dc043c1bbd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:33.238667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2e2dc0be-8891-4581-83b3-d4dc043c1bbd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:33.239177 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2e2dc0be-8891-4581-83b3-d4dc043c1bbd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:33.240151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2e2dc0be-8891-4581-83b3-d4dc043c1bbd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:33.240586 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2e2dc0be-8891-4581-83b3-d4dc043c1bbd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:33.281298 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-edebeca9-ba9b-4872-ab1e-649816a8e3e2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:33.282591 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-edebeca9-ba9b-4872-ab1e-649816a8e3e2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:33.290707 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-edebeca9-ba9b-4872-ab1e-649816a8e3e2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:33.304677 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-edebeca9-ba9b-4872-ab1e-649816a8e3e2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:33.305676 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-edebeca9-ba9b-4872-ab1e-649816a8e3e2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:33.306137 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-edebeca9-ba9b-4872-ab1e-649816a8e3e2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:33.482100 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2e2dc0be-8891-4581-83b3-d4dc043c1bbd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:33.495379 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2e2dc0be-8891-4581-83b3-d4dc043c1bbd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1364 microversion: 2.1 time: 0.269654 Jul 31 14:23:33.501111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 65/116] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:33 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1364 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:33.679255 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-edebeca9-ba9b-4872-ab1e-649816a8e3e2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:33.695657 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-edebeca9-ba9b-4872-ab1e-649816a8e3e2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:33.698216 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-edebeca9-ba9b-4872-ab1e-649816a8e3e2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:33.700740 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-edebeca9-ba9b-4872-ab1e-649816a8e3e2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1407 microversion: 2.20 time: 0.423788 Jul 31 14:23:33.701807 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 52/117] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:23:33 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1407 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:23:33.877540 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7f22b0b0-0e0b-475d-9d82-cf806f4a3063 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:33.880497 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7f22b0b0-0e0b-475d-9d82-cf806f4a3063 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:33.892176 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7f22b0b0-0e0b-475d-9d82-cf806f4a3063 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:33.896466 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7f22b0b0-0e0b-475d-9d82-cf806f4a3063 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:33.901276 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7f22b0b0-0e0b-475d-9d82-cf806f4a3063 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:33.901970 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7f22b0b0-0e0b-475d-9d82-cf806f4a3063 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:33.957131 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-14c8a246-4251-4421-b24b-0e648b096e1b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:33.958604 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-14c8a246-4251-4421-b24b-0e648b096e1b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:33.969480 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-14c8a246-4251-4421-b24b-0e648b096e1b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:33.970675 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-14c8a246-4251-4421-b24b-0e648b096e1b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:33.971611 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-14c8a246-4251-4421-b24b-0e648b096e1b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:33.972344 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-14c8a246-4251-4421-b24b-0e648b096e1b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:34.172213 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7f22b0b0-0e0b-475d-9d82-cf806f4a3063 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:34.179587 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-14c8a246-4251-4421-b24b-0e648b096e1b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:34.189627 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7f22b0b0-0e0b-475d-9d82-cf806f4a3063 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1322 microversion: 2.1 time: 0.319203 Jul 31 14:23:34.190224 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 66/118] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:33 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:34.198565 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-14c8a246-4251-4421-b24b-0e648b096e1b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1314 microversion: 2.1 time: 0.248451 Jul 31 14:23:34.199790 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 53/119] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:33 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:34.423385 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-86a4eac4-15a8-418b-9996-b5ef97f7e86e req-02ef4359-58ce-4d2f-8268-1c43413ce57b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712880e4-54c2-4ea2-b932-a8ff5efa0966", "name": "network-vif-plugged", "status": "completed", "tag": "fd1b1c90-9fee-4c88-917b-cd367e44842e"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:23:34.442248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-86a4eac4-15a8-418b-9996-b5ef97f7e86e req-02ef4359-58ce-4d2f-8268-1c43413ce57b service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:34.443165 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-86a4eac4-15a8-418b-9996-b5ef97f7e86e req-02ef4359-58ce-4d2f-8268-1c43413ce57b service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:34.456046 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-86a4eac4-15a8-418b-9996-b5ef97f7e86e req-02ef4359-58ce-4d2f-8268-1c43413ce57b service nova] Creating event network-vif-plugged:fd1b1c90-9fee-4c88-917b-cd367e44842e for instance 712880e4-54c2-4ea2-b932-a8ff5efa0966 on hv-cinder-84984 Jul 31 14:23:34.463212 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-86a4eac4-15a8-418b-9996-b5ef97f7e86e req-02ef4359-58ce-4d2f-8268-1c43413ce57b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043872 Jul 31 14:23:34.464053 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 67/120] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:23:34.516681 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7149aab4-d950-4ead-9f0b-49c53d306a5d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:34.517375 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7149aab4-d950-4ead-9f0b-49c53d306a5d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:34.523495 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7149aab4-d950-4ead-9f0b-49c53d306a5d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:34.523936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7149aab4-d950-4ead-9f0b-49c53d306a5d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:34.524746 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7149aab4-d950-4ead-9f0b-49c53d306a5d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:34.525124 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7149aab4-d950-4ead-9f0b-49c53d306a5d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:34.662018 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7149aab4-d950-4ead-9f0b-49c53d306a5d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:34.670102 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7149aab4-d950-4ead-9f0b-49c53d306a5d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1555 microversion: 2.1 time: 0.157202 Jul 31 14:23:34.670674 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 54/121] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:34 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:34.696626 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7940b2dc-bdda-41a3-b9cd-475ca0a17c8d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:34.697322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7940b2dc-bdda-41a3-b9cd-475ca0a17c8d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:34.704219 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7940b2dc-bdda-41a3-b9cd-475ca0a17c8d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:34.704799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7940b2dc-bdda-41a3-b9cd-475ca0a17c8d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:34.705621 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7940b2dc-bdda-41a3-b9cd-475ca0a17c8d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:34.706147 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7940b2dc-bdda-41a3-b9cd-475ca0a17c8d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:34.727658 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-1bbc56d8-fc07-40c6-92fe-4e7e7525f5d1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:34.728402 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-1bbc56d8-fc07-40c6-92fe-4e7e7525f5d1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:34.741568 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1bbc56d8-fc07-40c6-92fe-4e7e7525f5d1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:34.742322 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1bbc56d8-fc07-40c6-92fe-4e7e7525f5d1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:34.743826 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1bbc56d8-fc07-40c6-92fe-4e7e7525f5d1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:34.744438 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1bbc56d8-fc07-40c6-92fe-4e7e7525f5d1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:34.834377 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7940b2dc-bdda-41a3-b9cd-475ca0a17c8d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.145596 Jul 31 14:23:34.835044 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 68/122] 10.222.0.40 () {58 vars in 1275 bytes} [Sun Jul 31 14:23:34 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b/os-interface => generated 285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:23:34.968846 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-1bbc56d8-fc07-40c6-92fe-4e7e7525f5d1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:34.981646 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-1bbc56d8-fc07-40c6-92fe-4e7e7525f5d1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:34.981646 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-1bbc56d8-fc07-40c6-92fe-4e7e7525f5d1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:34.983881 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-1bbc56d8-fc07-40c6-92fe-4e7e7525f5d1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1407 microversion: 2.20 time: 0.261871 Jul 31 14:23:35.002053 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 55/123] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:23:34 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:23:35.213116 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0ee8c039-4ceb-48a6-aab1-f704a55aa67d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:35.214256 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0ee8c039-4ceb-48a6-aab1-f704a55aa67d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:35.226344 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-a3124e03-2366-48ea-b852-ac2a9bbe82e2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:35.227128 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-a3124e03-2366-48ea-b852-ac2a9bbe82e2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:35.244045 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a3124e03-2366-48ea-b852-ac2a9bbe82e2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:35.246310 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0ee8c039-4ceb-48a6-aab1-f704a55aa67d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:35.246771 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0ee8c039-4ceb-48a6-aab1-f704a55aa67d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:35.252129 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a3124e03-2366-48ea-b852-ac2a9bbe82e2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:35.252963 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a3124e03-2366-48ea-b852-ac2a9bbe82e2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:35.255011 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0ee8c039-4ceb-48a6-aab1-f704a55aa67d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:35.255586 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0ee8c039-4ceb-48a6-aab1-f704a55aa67d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:35.260958 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a3124e03-2366-48ea-b852-ac2a9bbe82e2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:35.507668 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a3124e03-2366-48ea-b852-ac2a9bbe82e2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:35.521883 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-a3124e03-2366-48ea-b852-ac2a9bbe82e2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1314 microversion: 2.1 time: 0.303601 Jul 31 14:23:35.523135 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 56/124] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:35 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:35.747106 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0ee8c039-4ceb-48a6-aab1-f704a55aa67d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:35.756669 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0ee8c039-4ceb-48a6-aab1-f704a55aa67d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1515 microversion: 2.1 time: 0.547345 Jul 31 14:23:35.772894 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 69/125] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:35 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1515 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:35.781681 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b1070f60-0d8c-449d-835d-9f77a5ed1b14 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:23:35.784329 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b1070f60-0d8c-449d-835d-9f77a5ed1b14 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:35.793979 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b1070f60-0d8c-449d-835d-9f77a5ed1b14 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:35.794748 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b1070f60-0d8c-449d-835d-9f77a5ed1b14 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:35.795694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b1070f60-0d8c-449d-835d-9f77a5ed1b14 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:35.796208 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b1070f60-0d8c-449d-835d-9f77a5ed1b14 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:35.875051 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.objects.instance [None req-b1070f60-0d8c-449d-835d-9f77a5ed1b14 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lazy-loading 'flavor' on Instance uuid b525f36f-61be-4205-85c9-112378b82b28 {{(pid=117781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:23:36.015154 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6f288d68-b1fa-4866-9165-72500a17c096 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:36.016582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6f288d68-b1fa-4866-9165-72500a17c096 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:36.029127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6f288d68-b1fa-4866-9165-72500a17c096 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:36.029574 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6f288d68-b1fa-4866-9165-72500a17c096 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:36.032363 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6f288d68-b1fa-4866-9165-72500a17c096 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:36.034483 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6f288d68-b1fa-4866-9165-72500a17c096 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:36.038059 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b1070f60-0d8c-449d-835d-9f77a5ed1b14 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "POST /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28/action" status: 200 len: 32 microversion: 2.1 time: 0.260481 Jul 31 14:23:36.040151 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 57/126] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Jul 31 14:23:35 2022] POST /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28/action => generated 32 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 14:23:36.054520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-69b5e8df-a9f8-4893-b4cd-00da24695636 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:36.055294 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-69b5e8df-a9f8-4893-b4cd-00da24695636 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:36.069385 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-69b5e8df-a9f8-4893-b4cd-00da24695636 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:36.069843 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-69b5e8df-a9f8-4893-b4cd-00da24695636 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:36.070622 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-69b5e8df-a9f8-4893-b4cd-00da24695636 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:36.071088 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-69b5e8df-a9f8-4893-b4cd-00da24695636 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:36.310561 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6f288d68-b1fa-4866-9165-72500a17c096 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:36.327465 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6f288d68-b1fa-4866-9165-72500a17c096 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:36.329810 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6f288d68-b1fa-4866-9165-72500a17c096 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:36.331412 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6f288d68-b1fa-4866-9165-72500a17c096 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1407 microversion: 2.20 time: 0.321017 Jul 31 14:23:36.333416 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 70/127] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:23:36 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1407 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:23:36.455185 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-69b5e8df-a9f8-4893-b4cd-00da24695636 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:36.478276 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-69b5e8df-a9f8-4893-b4cd-00da24695636 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.431007 Jul 31 14:23:36.479151 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 58/128] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:36 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:36.556578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-abe551ef-1204-4991-92ab-51d01bfb00d2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:36.557192 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-abe551ef-1204-4991-92ab-51d01bfb00d2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:36.571484 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-abe551ef-1204-4991-92ab-51d01bfb00d2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:36.571934 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-abe551ef-1204-4991-92ab-51d01bfb00d2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:36.572826 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-abe551ef-1204-4991-92ab-51d01bfb00d2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:36.573336 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-abe551ef-1204-4991-92ab-51d01bfb00d2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:36.715881 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-009af5a5-7734-4745-a0d5-628b1107fbfa req-9ffe5bd4-2666-4579-8e76-b95950996f45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0810b36-49ee-482b-9e65-f587148b2a81", "name": "network-vif-plugged", "status": "completed", "tag": "24bdbc3b-fa2f-407d-8ddb-f37abeee2dba"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:23:36.732745 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-009af5a5-7734-4745-a0d5-628b1107fbfa req-9ffe5bd4-2666-4579-8e76-b95950996f45 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:36.733306 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-009af5a5-7734-4745-a0d5-628b1107fbfa req-9ffe5bd4-2666-4579-8e76-b95950996f45 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:36.764670 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-009af5a5-7734-4745-a0d5-628b1107fbfa req-9ffe5bd4-2666-4579-8e76-b95950996f45 service nova] Creating event network-vif-plugged:24bdbc3b-fa2f-407d-8ddb-f37abeee2dba for instance d0810b36-49ee-482b-9e65-f587148b2a81 on hv-cinder-84984 Jul 31 14:23:36.771633 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-009af5a5-7734-4745-a0d5-628b1107fbfa req-9ffe5bd4-2666-4579-8e76-b95950996f45 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059396 Jul 31 14:23:36.772491 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 59/129] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:23:36.907947 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-abe551ef-1204-4991-92ab-51d01bfb00d2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:36.916331 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-abe551ef-1204-4991-92ab-51d01bfb00d2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1314 microversion: 2.1 time: 0.363658 Jul 31 14:23:36.922309 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 71/130] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:36 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:37.357842 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-09272327-c260-43a3-9479-f61451a009ce tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:37.358747 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-09272327-c260-43a3-9479-f61451a009ce tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:37.374885 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-09272327-c260-43a3-9479-f61451a009ce tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:37.375361 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-09272327-c260-43a3-9479-f61451a009ce tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:37.377937 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-09272327-c260-43a3-9479-f61451a009ce tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:37.380565 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-09272327-c260-43a3-9479-f61451a009ce tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:37.410231 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-61378b94-e419-4a04-8a07-ee91381151cf req-26d1193f-67c5-43e6-8176-0991c5547494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4f24854-1bcd-405b-9af8-fd3f3967d16b", "tag": "21edb8cd-f77a-499c-afac-f0de24050b9d"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:23:37.431011 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-61378b94-e419-4a04-8a07-ee91381151cf req-26d1193f-67c5-43e6-8176-0991c5547494 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:37.431859 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-61378b94-e419-4a04-8a07-ee91381151cf req-26d1193f-67c5-43e6-8176-0991c5547494 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:37.460044 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-61378b94-e419-4a04-8a07-ee91381151cf req-26d1193f-67c5-43e6-8176-0991c5547494 service nova] Creating event network-changed:21edb8cd-f77a-499c-afac-f0de24050b9d for instance e4f24854-1bcd-405b-9af8-fd3f3967d16b on hv-cinder-84984 Jul 31 14:23:37.469855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-61378b94-e419-4a04-8a07-ee91381151cf req-26d1193f-67c5-43e6-8176-0991c5547494 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063238 Jul 31 14:23:37.472459 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 72/131] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:23:37.503858 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-bbde1a02-a6cb-4484-b5d4-f1f48af87886 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:37.505278 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-bbde1a02-a6cb-4484-b5d4-f1f48af87886 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:37.517887 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bbde1a02-a6cb-4484-b5d4-f1f48af87886 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:37.518715 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bbde1a02-a6cb-4484-b5d4-f1f48af87886 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:37.520367 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bbde1a02-a6cb-4484-b5d4-f1f48af87886 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:37.522324 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bbde1a02-a6cb-4484-b5d4-f1f48af87886 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:37.756908 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bbde1a02-a6cb-4484-b5d4-f1f48af87886 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:37.786084 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-bbde1a02-a6cb-4484-b5d4-f1f48af87886 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.287678 Jul 31 14:23:37.787932 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 73/132] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:37 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:37.946204 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-bd299acd-c474-4cf0-92e5-4703aa68d7fc tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:37.947345 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-bd299acd-c474-4cf0-92e5-4703aa68d7fc tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:37.960056 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bd299acd-c474-4cf0-92e5-4703aa68d7fc tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:37.961151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bd299acd-c474-4cf0-92e5-4703aa68d7fc tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:37.962425 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bd299acd-c474-4cf0-92e5-4703aa68d7fc tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:37.963886 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bd299acd-c474-4cf0-92e5-4703aa68d7fc tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:38.063059 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-09272327-c260-43a3-9479-f61451a009ce tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:38.080455 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-09272327-c260-43a3-9479-f61451a009ce tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:38.088864 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-09272327-c260-43a3-9479-f61451a009ce tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:38.104102 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-09272327-c260-43a3-9479-f61451a009ce tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1407 microversion: 2.20 time: 0.738215 Jul 31 14:23:38.106499 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 60/133] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:23:37 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1407 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:23:38.244962 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bd299acd-c474-4cf0-92e5-4703aa68d7fc tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:38.252506 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-bd299acd-c474-4cf0-92e5-4703aa68d7fc tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1314 microversion: 2.1 time: 0.311293 Jul 31 14:23:38.253088 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 74/134] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:37 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:38.818689 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-84b99168-3f2f-44d3-a448-56a1ebedd256 req-fff50f02-d35d-4927-a2bf-2363790912d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c15a0e90-90b9-47be-a034-3de7757c7bcb", "name": "network-vif-plugged", "status": "completed", "tag": "4e3565ba-9723-4b87-a1a4-bbb331da879d"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:23:38.820524 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-4283c019-0574-4711-af63-eb2bec8f91bf tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:38.823707 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-4283c019-0574-4711-af63-eb2bec8f91bf tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:38.838554 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4283c019-0574-4711-af63-eb2bec8f91bf tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:38.839014 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4283c019-0574-4711-af63-eb2bec8f91bf tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:38.844280 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4283c019-0574-4711-af63-eb2bec8f91bf tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:38.844735 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4283c019-0574-4711-af63-eb2bec8f91bf tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:38.845698 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-84b99168-3f2f-44d3-a448-56a1ebedd256 req-fff50f02-d35d-4927-a2bf-2363790912d6 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:38.847305 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-84b99168-3f2f-44d3-a448-56a1ebedd256 req-fff50f02-d35d-4927-a2bf-2363790912d6 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:38.876234 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-84b99168-3f2f-44d3-a448-56a1ebedd256 req-fff50f02-d35d-4927-a2bf-2363790912d6 service nova] Creating event network-vif-plugged:4e3565ba-9723-4b87-a1a4-bbb331da879d for instance c15a0e90-90b9-47be-a034-3de7757c7bcb on hv-cinder-84984 Jul 31 14:23:38.888942 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-84b99168-3f2f-44d3-a448-56a1ebedd256 req-fff50f02-d35d-4927-a2bf-2363790912d6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074383 Jul 31 14:23:38.889977 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 75/135] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:23:39.072596 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-4283c019-0574-4711-af63-eb2bec8f91bf tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:39.084257 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-4283c019-0574-4711-af63-eb2bec8f91bf tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.279091 Jul 31 14:23:39.098755 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 61/136] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:38 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:39.130201 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-cff06081-df0e-4834-a10f-d9c8879a2a62 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:39.130904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-cff06081-df0e-4834-a10f-d9c8879a2a62 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:39.139087 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cff06081-df0e-4834-a10f-d9c8879a2a62 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:39.139753 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cff06081-df0e-4834-a10f-d9c8879a2a62 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:39.140761 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cff06081-df0e-4834-a10f-d9c8879a2a62 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:39.141428 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cff06081-df0e-4834-a10f-d9c8879a2a62 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:39.276224 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-62f6e35f-e3e8-4e18-8995-44cda246dcae tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:39.276980 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-62f6e35f-e3e8-4e18-8995-44cda246dcae tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:39.292039 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-62f6e35f-e3e8-4e18-8995-44cda246dcae tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:39.296229 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-62f6e35f-e3e8-4e18-8995-44cda246dcae tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:39.298271 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-62f6e35f-e3e8-4e18-8995-44cda246dcae tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:39.299977 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-62f6e35f-e3e8-4e18-8995-44cda246dcae tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:39.444815 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-cff06081-df0e-4834-a10f-d9c8879a2a62 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:39.460019 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-cff06081-df0e-4834-a10f-d9c8879a2a62 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:39.461524 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-cff06081-df0e-4834-a10f-d9c8879a2a62 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:39.462738 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-cff06081-df0e-4834-a10f-d9c8879a2a62 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1599 microversion: 2.20 time: 0.337907 Jul 31 14:23:39.471633 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 76/137] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:23:39 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1599 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:23:39.496961 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-554afa71-9714-4694-8edf-33fdc3ba51fd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:39.497445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-554afa71-9714-4694-8edf-33fdc3ba51fd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:39.520718 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-554afa71-9714-4694-8edf-33fdc3ba51fd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:39.521394 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-554afa71-9714-4694-8edf-33fdc3ba51fd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:39.522420 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-554afa71-9714-4694-8edf-33fdc3ba51fd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:39.523000 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-554afa71-9714-4694-8edf-33fdc3ba51fd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:39.584743 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=100 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:23:39.698570 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-554afa71-9714-4694-8edf-33fdc3ba51fd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.202309 Jul 31 14:23:39.698570 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 77/138] 10.222.0.40 () {60 vars in 1316 bytes} [Sun Jul 31 14:23:39 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81/os-interface => generated 284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 31 14:23:39.850389 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-62f6e35f-e3e8-4e18-8995-44cda246dcae tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:39.872353 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-62f6e35f-e3e8-4e18-8995-44cda246dcae tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1314 microversion: 2.1 time: 0.603171 Jul 31 14:23:39.886752 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 62/139] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:39 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:40.106594 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8acab810-f737-4113-bfbc-064d9c6314cb tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:40.107199 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8acab810-f737-4113-bfbc-064d9c6314cb tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:40.115541 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8acab810-f737-4113-bfbc-064d9c6314cb tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:40.116040 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8acab810-f737-4113-bfbc-064d9c6314cb tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:40.117101 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8acab810-f737-4113-bfbc-064d9c6314cb tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:40.117727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8acab810-f737-4113-bfbc-064d9c6314cb tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:40.767969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8acab810-f737-4113-bfbc-064d9c6314cb tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:40.794955 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8acab810-f737-4113-bfbc-064d9c6314cb tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.693492 Jul 31 14:23:40.798984 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 78/140] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:40 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:40.896245 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b57e7daf-80b4-4693-894d-93ecd727dfe2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:40.897209 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b57e7daf-80b4-4693-894d-93ecd727dfe2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:40.913098 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b57e7daf-80b4-4693-894d-93ecd727dfe2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:40.915936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b57e7daf-80b4-4693-894d-93ecd727dfe2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:40.916980 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b57e7daf-80b4-4693-894d-93ecd727dfe2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:40.917578 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b57e7daf-80b4-4693-894d-93ecd727dfe2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:41.214562 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b57e7daf-80b4-4693-894d-93ecd727dfe2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:41.223298 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b57e7daf-80b4-4693-894d-93ecd727dfe2 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1314 microversion: 2.1 time: 0.333101 Jul 31 14:23:41.223924 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 63/141] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:40 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:41.823452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-abea99a5-9168-40fe-805a-3bdccab6c50f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:41.826113 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-abea99a5-9168-40fe-805a-3bdccab6c50f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:41.833832 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=91 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:23:41.839865 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-abea99a5-9168-40fe-805a-3bdccab6c50f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:41.841022 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-abea99a5-9168-40fe-805a-3bdccab6c50f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:41.843162 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-abea99a5-9168-40fe-805a-3bdccab6c50f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:41.843849 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-abea99a5-9168-40fe-805a-3bdccab6c50f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:42.147270 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-abea99a5-9168-40fe-805a-3bdccab6c50f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:42.155178 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-abea99a5-9168-40fe-805a-3bdccab6c50f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.340796 Jul 31 14:23:42.156144 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 79/142] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:41 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:42.244982 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-28e7b264-f336-4dd1-9deb-19473c78752b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:42.245577 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-28e7b264-f336-4dd1-9deb-19473c78752b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:42.252671 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-28e7b264-f336-4dd1-9deb-19473c78752b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:42.253396 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-28e7b264-f336-4dd1-9deb-19473c78752b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:42.255001 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-28e7b264-f336-4dd1-9deb-19473c78752b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:42.255679 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-28e7b264-f336-4dd1-9deb-19473c78752b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:42.341342 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-a7bde31a-1a38-4269-ae1d-1006d1ca2e72 req-546ecfec-bf06-49f9-8d50-53aab796fee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0810b36-49ee-482b-9e65-f587148b2a81", "tag": "24bdbc3b-fa2f-407d-8ddb-f37abeee2dba"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:23:42.352493 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-a7bde31a-1a38-4269-ae1d-1006d1ca2e72 req-546ecfec-bf06-49f9-8d50-53aab796fee8 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:42.352934 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-a7bde31a-1a38-4269-ae1d-1006d1ca2e72 req-546ecfec-bf06-49f9-8d50-53aab796fee8 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:42.366977 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-a7bde31a-1a38-4269-ae1d-1006d1ca2e72 req-546ecfec-bf06-49f9-8d50-53aab796fee8 service nova] Creating event network-changed:24bdbc3b-fa2f-407d-8ddb-f37abeee2dba for instance d0810b36-49ee-482b-9e65-f587148b2a81 on hv-cinder-84984 Jul 31 14:23:42.373720 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-a7bde31a-1a38-4269-ae1d-1006d1ca2e72 req-546ecfec-bf06-49f9-8d50-53aab796fee8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036207 Jul 31 14:23:42.378237 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 80/143] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:23:42.646564 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-28e7b264-f336-4dd1-9deb-19473c78752b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:42.653915 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-28e7b264-f336-4dd1-9deb-19473c78752b tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1501 microversion: 2.1 time: 0.412660 Jul 31 14:23:42.654486 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 64/144] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:42 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1501 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:43.178716 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8f918039-7672-4520-8aa8-b970847113e9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:43.179401 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8f918039-7672-4520-8aa8-b970847113e9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:43.211804 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8f918039-7672-4520-8aa8-b970847113e9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:43.217100 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8f918039-7672-4520-8aa8-b970847113e9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:43.217928 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8f918039-7672-4520-8aa8-b970847113e9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:43.218366 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8f918039-7672-4520-8aa8-b970847113e9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:43.406150 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-fab618fc-d3cf-4566-a3e4-f335cb9a9b16 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1300397378", "imageRef": "57bc051a-64d0-4317-aa93-a7a2aed39369", "flavorRef": "452", "networks": [{"uuid": "241a7056-b8af-4415-9520-9854cbe33cc1"}]}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:23:43.475372 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.network.neutron [None req-fab618fc-d3cf-4566-a3e4-f335cb9a9b16 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] validate_networks() for [('241a7056-b8af-4415-9520-9854cbe33cc1', None, None, None, None, None)] {{(pid=117781) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 14:23:43.570166 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8f918039-7672-4520-8aa8-b970847113e9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:43.578789 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8f918039-7672-4520-8aa8-b970847113e9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.405785 Jul 31 14:23:43.585600 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 81/145] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:43 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:44.365482 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-861da892-ed98-4808-8382-cb326fd0cef3 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ebef806-0ed6-4069-b330-ad79c8f457a9"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:23:44.369021 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-861da892-ed98-4808-8382-cb326fd0cef3 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:44.381508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-861da892-ed98-4808-8382-cb326fd0cef3 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:44.386083 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-861da892-ed98-4808-8382-cb326fd0cef3 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:44.386940 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-861da892-ed98-4808-8382-cb326fd0cef3 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:44.387387 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-861da892-ed98-4808-8382-cb326fd0cef3 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:44.413651 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-fab618fc-d3cf-4566-a3e4-f335cb9a9b16 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Flavor limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 14:23:44.414735 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-fab618fc-d3cf-4566-a3e4-f335cb9a9b16 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Image limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 14:23:44.416791 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-fab618fc-d3cf-4566-a3e4-f335cb9a9b16 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Flavor pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 14:23:44.417186 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-fab618fc-d3cf-4566-a3e4-f335cb9a9b16 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Image pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 14:23:44.417724 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-fab618fc-d3cf-4566-a3e4-f335cb9a9b16 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 14:23:44.448795 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fab618fc-d3cf-4566-a3e4-f335cb9a9b16 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:44.449360 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fab618fc-d3cf-4566-a3e4-f335cb9a9b16 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:44.450508 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fab618fc-d3cf-4566-a3e4-f335cb9a9b16 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:44.450953 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fab618fc-d3cf-4566-a3e4-f335cb9a9b16 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:44.502619 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-fab618fc-d3cf-4566-a3e4-f335cb9a9b16 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Getting quotas for project b8656d0df1af4475b502efe677f7308e. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:23:44.511381 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-fab618fc-d3cf-4566-a3e4-f335cb9a9b16 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Getting quotas for user d33866c1c77541a4bfd12d441e7ab175 and project b8656d0df1af4475b502efe677f7308e. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:23:44.526477 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-fab618fc-d3cf-4566-a3e4-f335cb9a9b16 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Going to run 1 instances... {{(pid=117781) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 14:23:44.529630 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-fab618fc-d3cf-4566-a3e4-f335cb9a9b16 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57bc051a-64d0-4317-aa93-a7a2aed39369',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117781) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 14:23:44.612498 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-fab618fc-d3cf-4566-a3e4-f335cb9a9b16 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.210510 Jul 31 14:23:44.614152 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 65/146] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Jul 31 14:23:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 14:23:44.618889 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-295aa063-4203-43d4-b7c2-3f159fb18696 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:44.619821 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-295aa063-4203-43d4-b7c2-3f159fb18696 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:44.627485 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-295aa063-4203-43d4-b7c2-3f159fb18696 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:44.628380 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-295aa063-4203-43d4-b7c2-3f159fb18696 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:44.630481 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-295aa063-4203-43d4-b7c2-3f159fb18696 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:44.631135 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-295aa063-4203-43d4-b7c2-3f159fb18696 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:44.664599 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:23:44.900096 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-295aa063-4203-43d4-b7c2-3f159fb18696 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:44.914486 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-295aa063-4203-43d4-b7c2-3f159fb18696 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.298664 Jul 31 14:23:44.915304 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 66/147] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:44 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:44.928977 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-91345deb-9496-4712-b2a7-cf8340a1593f tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:44.929577 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-91345deb-9496-4712-b2a7-cf8340a1593f tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:44.987570 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-861da892-ed98-4808-8382-cb326fd0cef3 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "POST /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.627250 Jul 31 14:23:44.988094 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 82/148] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Jul 31 14:23:44 2022] POST /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb/os-volume_attachments => generated 194 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:23:45.095150 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-91345deb-9496-4712-b2a7-cf8340a1593f tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:45.103605 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-91345deb-9496-4712-b2a7-cf8340a1593f tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72" status: 200 len: 1214 microversion: 2.1 time: 0.186950 Jul 31 14:23:45.113964 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 67/149] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:44 2022] GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72 => generated 1214 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:45.938594 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f3fb5048-dd68-4d4e-be93-bcadd53c6d23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:45.939461 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f3fb5048-dd68-4d4e-be93-bcadd53c6d23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:45.953569 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f3fb5048-dd68-4d4e-be93-bcadd53c6d23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:45.954591 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f3fb5048-dd68-4d4e-be93-bcadd53c6d23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:45.955690 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f3fb5048-dd68-4d4e-be93-bcadd53c6d23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:45.956533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f3fb5048-dd68-4d4e-be93-bcadd53c6d23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:46.126485 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f3fb5048-dd68-4d4e-be93-bcadd53c6d23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:46.137774 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-22c17d4e-fbda-4a32-b9f5-fe7b080650e6 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:46.138694 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f3fb5048-dd68-4d4e-be93-bcadd53c6d23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.204179 Jul 31 14:23:46.152599 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 83/150] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:45 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:46.157806 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-22c17d4e-fbda-4a32-b9f5-fe7b080650e6 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:46.175610 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-22c17d4e-fbda-4a32-b9f5-fe7b080650e6 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:46.176610 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-22c17d4e-fbda-4a32-b9f5-fe7b080650e6 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:46.177390 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-22c17d4e-fbda-4a32-b9f5-fe7b080650e6 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:46.177821 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-22c17d4e-fbda-4a32-b9f5-fe7b080650e6 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:46.276177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-22c17d4e-fbda-4a32-b9f5-fe7b080650e6 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:46.283491 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-22c17d4e-fbda-4a32-b9f5-fe7b080650e6 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72" status: 200 len: 1266 microversion: 2.1 time: 0.149637 Jul 31 14:23:46.284065 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 68/151] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:46 2022] GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:47.162575 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-28ae1033-074e-4585-aac7-93b8be76b821 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:47.163184 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-28ae1033-074e-4585-aac7-93b8be76b821 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:47.170120 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-28ae1033-074e-4585-aac7-93b8be76b821 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:47.170632 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-28ae1033-074e-4585-aac7-93b8be76b821 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:47.173894 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-28ae1033-074e-4585-aac7-93b8be76b821 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:47.174345 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-28ae1033-074e-4585-aac7-93b8be76b821 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:47.307840 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-2894229a-922e-4f0a-acf7-db43043ab536 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:47.308548 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-2894229a-922e-4f0a-acf7-db43043ab536 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:47.320923 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2894229a-922e-4f0a-acf7-db43043ab536 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:47.321372 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2894229a-922e-4f0a-acf7-db43043ab536 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:47.322146 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2894229a-922e-4f0a-acf7-db43043ab536 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:47.329347 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2894229a-922e-4f0a-acf7-db43043ab536 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:47.412457 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-28ae1033-074e-4585-aac7-93b8be76b821 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:47.420368 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-28ae1033-074e-4585-aac7-93b8be76b821 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.262095 Jul 31 14:23:47.420942 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 84/152] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:47 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:47.507579 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-2894229a-922e-4f0a-acf7-db43043ab536 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:47.519828 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-2894229a-922e-4f0a-acf7-db43043ab536 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72" status: 200 len: 1272 microversion: 2.1 time: 0.217115 Jul 31 14:23:47.521621 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 69/153] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:47 2022] GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72 => generated 1272 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:48.441420 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c66d8813-6b29-49dc-bab9-aa060cfa050c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:48.443354 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c66d8813-6b29-49dc-bab9-aa060cfa050c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:48.453006 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c66d8813-6b29-49dc-bab9-aa060cfa050c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:48.454637 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c66d8813-6b29-49dc-bab9-aa060cfa050c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:48.461173 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c66d8813-6b29-49dc-bab9-aa060cfa050c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:48.461876 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c66d8813-6b29-49dc-bab9-aa060cfa050c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:48.544654 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7565a19d-b7ca-46ce-a353-2ff17e23db05 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:48.546442 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7565a19d-b7ca-46ce-a353-2ff17e23db05 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:48.557874 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7565a19d-b7ca-46ce-a353-2ff17e23db05 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:48.558634 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7565a19d-b7ca-46ce-a353-2ff17e23db05 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:48.559994 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7565a19d-b7ca-46ce-a353-2ff17e23db05 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:48.560581 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7565a19d-b7ca-46ce-a353-2ff17e23db05 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:48.663463 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c66d8813-6b29-49dc-bab9-aa060cfa050c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:48.672102 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c66d8813-6b29-49dc-bab9-aa060cfa050c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.234398 Jul 31 14:23:48.672663 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 85/154] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:48 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:48.795890 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7565a19d-b7ca-46ce-a353-2ff17e23db05 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:48.809383 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7565a19d-b7ca-46ce-a353-2ff17e23db05 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72" status: 200 len: 1314 microversion: 2.1 time: 0.269152 Jul 31 14:23:48.821137 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 70/155] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:48 2022] GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:49.074878 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-82383233-4ae7-4db8-8d5f-a0631ab6e90e req-17d6aa6e-d434-4fc2-8caa-3ada15973f5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5946aed-8d23-4b14-b806-c62c21468d72", "tag": "d3ccc265-c1e6-4590-bdce-3c7fcebbe512"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:23:49.101812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-82383233-4ae7-4db8-8d5f-a0631ab6e90e req-17d6aa6e-d434-4fc2-8caa-3ada15973f5e service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:49.102604 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-82383233-4ae7-4db8-8d5f-a0631ab6e90e req-17d6aa6e-d434-4fc2-8caa-3ada15973f5e service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:49.115015 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-82383233-4ae7-4db8-8d5f-a0631ab6e90e req-17d6aa6e-d434-4fc2-8caa-3ada15973f5e service nova] Creating event network-changed:d3ccc265-c1e6-4590-bdce-3c7fcebbe512 for instance e5946aed-8d23-4b14-b806-c62c21468d72 on hv-cinder-84984 Jul 31 14:23:49.120430 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-82383233-4ae7-4db8-8d5f-a0631ab6e90e req-17d6aa6e-d434-4fc2-8caa-3ada15973f5e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048946 Jul 31 14:23:49.121611 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 86/156] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:23:49.696579 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-96608e7b-c796-4d28-b9b7-e63e4f861e23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:49.697100 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-96608e7b-c796-4d28-b9b7-e63e4f861e23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:49.705870 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-96608e7b-c796-4d28-b9b7-e63e4f861e23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:49.706619 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-96608e7b-c796-4d28-b9b7-e63e4f861e23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:49.708209 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-96608e7b-c796-4d28-b9b7-e63e4f861e23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:49.708675 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-96608e7b-c796-4d28-b9b7-e63e4f861e23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:49.834490 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3be4b91f-bb5a-45e1-aa7c-781209fb73c7 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:49.835781 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3be4b91f-bb5a-45e1-aa7c-781209fb73c7 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:49.844223 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3be4b91f-bb5a-45e1-aa7c-781209fb73c7 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:49.844846 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3be4b91f-bb5a-45e1-aa7c-781209fb73c7 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:49.845990 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3be4b91f-bb5a-45e1-aa7c-781209fb73c7 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:49.846573 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3be4b91f-bb5a-45e1-aa7c-781209fb73c7 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:49.868622 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-96608e7b-c796-4d28-b9b7-e63e4f861e23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:49.880077 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-96608e7b-c796-4d28-b9b7-e63e4f861e23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.189077 Jul 31 14:23:49.880754 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 71/157] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:49 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:50.006463 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3be4b91f-bb5a-45e1-aa7c-781209fb73c7 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:50.014388 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3be4b91f-bb5a-45e1-aa7c-781209fb73c7 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72" status: 200 len: 1314 microversion: 2.1 time: 0.187410 Jul 31 14:23:50.015221 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 87/158] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:49 2022] GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:50.901263 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-fb15309e-a75d-44e0-9562-57a4d2fd094e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:50.901874 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-fb15309e-a75d-44e0-9562-57a4d2fd094e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:50.907881 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fb15309e-a75d-44e0-9562-57a4d2fd094e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:50.908322 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fb15309e-a75d-44e0-9562-57a4d2fd094e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:50.909075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fb15309e-a75d-44e0-9562-57a4d2fd094e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:50.909513 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fb15309e-a75d-44e0-9562-57a4d2fd094e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:51.039408 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6099c9f4-7ade-4f78-af2d-2267b01136e0 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:51.040065 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6099c9f4-7ade-4f78-af2d-2267b01136e0 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:51.054546 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6099c9f4-7ade-4f78-af2d-2267b01136e0 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:51.055013 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6099c9f4-7ade-4f78-af2d-2267b01136e0 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:51.055847 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6099c9f4-7ade-4f78-af2d-2267b01136e0 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:51.056285 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6099c9f4-7ade-4f78-af2d-2267b01136e0 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:51.091698 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-fb15309e-a75d-44e0-9562-57a4d2fd094e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:51.099165 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-fb15309e-a75d-44e0-9562-57a4d2fd094e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.201778 Jul 31 14:23:51.099905 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 72/159] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:50 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:51.226792 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6099c9f4-7ade-4f78-af2d-2267b01136e0 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:51.234124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6099c9f4-7ade-4f78-af2d-2267b01136e0 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72" status: 200 len: 1314 microversion: 2.1 time: 0.201884 Jul 31 14:23:51.234681 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 88/160] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:51 2022] GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:52.128699 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-65b49774-c94e-4e23-941e-3ce90caa4011 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:52.129937 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-65b49774-c94e-4e23-941e-3ce90caa4011 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:52.136032 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-65b49774-c94e-4e23-941e-3ce90caa4011 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:52.136482 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-65b49774-c94e-4e23-941e-3ce90caa4011 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:52.137251 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-65b49774-c94e-4e23-941e-3ce90caa4011 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:52.138081 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-65b49774-c94e-4e23-941e-3ce90caa4011 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:52.256613 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b1ce618e-6f48-465c-8854-66e416eb7fa6 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:52.257394 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b1ce618e-6f48-465c-8854-66e416eb7fa6 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:52.264463 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b1ce618e-6f48-465c-8854-66e416eb7fa6 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:52.265127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b1ce618e-6f48-465c-8854-66e416eb7fa6 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:52.266120 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b1ce618e-6f48-465c-8854-66e416eb7fa6 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:52.266620 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b1ce618e-6f48-465c-8854-66e416eb7fa6 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:52.281106 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-65b49774-c94e-4e23-941e-3ce90caa4011 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:52.291809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-65b49774-c94e-4e23-941e-3ce90caa4011 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.173370 Jul 31 14:23:52.292471 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 73/161] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:52 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:52.409261 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b1ce618e-6f48-465c-8854-66e416eb7fa6 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:52.417107 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b1ce618e-6f48-465c-8854-66e416eb7fa6 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72" status: 200 len: 1314 microversion: 2.1 time: 0.165690 Jul 31 14:23:52.417619 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 89/162] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:52 2022] GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:53.313188 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-35b05ae6-59e0-4512-aec0-04a7e8015ca2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:53.313831 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-35b05ae6-59e0-4512-aec0-04a7e8015ca2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:53.320876 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-35b05ae6-59e0-4512-aec0-04a7e8015ca2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:53.321392 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-35b05ae6-59e0-4512-aec0-04a7e8015ca2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:53.322227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-35b05ae6-59e0-4512-aec0-04a7e8015ca2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:53.322767 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-35b05ae6-59e0-4512-aec0-04a7e8015ca2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:53.438029 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-72f0f175-4387-4315-847e-ffcc48e14711 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:53.438642 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-72f0f175-4387-4315-847e-ffcc48e14711 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:53.445664 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-72f0f175-4387-4315-847e-ffcc48e14711 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:53.446342 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-72f0f175-4387-4315-847e-ffcc48e14711 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:53.447486 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-72f0f175-4387-4315-847e-ffcc48e14711 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:53.447927 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-72f0f175-4387-4315-847e-ffcc48e14711 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:53.479625 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-35b05ae6-59e0-4512-aec0-04a7e8015ca2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:53.490490 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-35b05ae6-59e0-4512-aec0-04a7e8015ca2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.180854 Jul 31 14:23:53.491893 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 74/163] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:53 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:53.632144 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-72f0f175-4387-4315-847e-ffcc48e14711 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:53.640141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-72f0f175-4387-4315-847e-ffcc48e14711 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72" status: 200 len: 1314 microversion: 2.1 time: 0.205827 Jul 31 14:23:53.640869 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 90/164] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:53 2022] GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:54.039490 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-67ea9320-8156-4d69-9d2d-8674960d8e84 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:54.039990 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-67ea9320-8156-4d69-9d2d-8674960d8e84 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:54.042062 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:23:54.047814 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-67ea9320-8156-4d69-9d2d-8674960d8e84 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:54.048267 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-67ea9320-8156-4d69-9d2d-8674960d8e84 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:54.049034 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-67ea9320-8156-4d69-9d2d-8674960d8e84 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:54.049471 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-67ea9320-8156-4d69-9d2d-8674960d8e84 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:54.077277 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-67ea9320-8156-4d69-9d2d-8674960d8e84 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Going to try to terminate instance {{(pid=117781) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 14:23:54.197774 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-67ea9320-8156-4d69-9d2d-8674960d8e84 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 204 len: 0 microversion: 2.1 time: 0.162101 Jul 31 14:23:54.198712 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 75/165] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:23:54 2022] DELETE /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 14:23:54.207345 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b2bbdb0c-0f37-4e9f-87e6-378924b920f5 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:54.208258 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b2bbdb0c-0f37-4e9f-87e6-378924b920f5 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:54.214945 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b2bbdb0c-0f37-4e9f-87e6-378924b920f5 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:54.215380 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b2bbdb0c-0f37-4e9f-87e6-378924b920f5 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:54.216173 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b2bbdb0c-0f37-4e9f-87e6-378924b920f5 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:54.216585 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b2bbdb0c-0f37-4e9f-87e6-378924b920f5 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:54.344859 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b2bbdb0c-0f37-4e9f-87e6-378924b920f5 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:54.352811 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b2bbdb0c-0f37-4e9f-87e6-378924b920f5 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1553 microversion: 2.1 time: 0.149522 Jul 31 14:23:54.353371 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 91/166] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:54 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:54.512463 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-25d27ae2-6028-4221-a577-c3fe5d938150 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:54.513188 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-25d27ae2-6028-4221-a577-c3fe5d938150 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:54.515083 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:23:54.520397 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-25d27ae2-6028-4221-a577-c3fe5d938150 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:54.520849 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-25d27ae2-6028-4221-a577-c3fe5d938150 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:54.521615 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-25d27ae2-6028-4221-a577-c3fe5d938150 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:54.522054 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-25d27ae2-6028-4221-a577-c3fe5d938150 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:54.652030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-25d27ae2-6028-4221-a577-c3fe5d938150 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:54.659718 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-25d27ae2-6028-4221-a577-c3fe5d938150 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.151471 Jul 31 14:23:54.660291 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 76/167] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:54 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:54.662453 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a2d95d08-6c2f-4cbc-a5c0-60e2489215bf tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:54.663058 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a2d95d08-6c2f-4cbc-a5c0-60e2489215bf tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:54.669501 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a2d95d08-6c2f-4cbc-a5c0-60e2489215bf tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:54.670087 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a2d95d08-6c2f-4cbc-a5c0-60e2489215bf tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:54.670708 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a2d95d08-6c2f-4cbc-a5c0-60e2489215bf tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:54.671193 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a2d95d08-6c2f-4cbc-a5c0-60e2489215bf tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:54.807015 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a2d95d08-6c2f-4cbc-a5c0-60e2489215bf tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:54.814835 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a2d95d08-6c2f-4cbc-a5c0-60e2489215bf tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72" status: 200 len: 1314 microversion: 2.1 time: 0.156650 Jul 31 14:23:54.815406 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 92/168] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:54 2022] GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:55.376890 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-70291cc8-df12-45bf-919f-cb5370f694e6 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:55.376890 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-70291cc8-df12-45bf-919f-cb5370f694e6 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:55.377078 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=8 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:23:55.382822 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-70291cc8-df12-45bf-919f-cb5370f694e6 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:55.383288 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-70291cc8-df12-45bf-919f-cb5370f694e6 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:55.384080 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-70291cc8-df12-45bf-919f-cb5370f694e6 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:55.384516 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-70291cc8-df12-45bf-919f-cb5370f694e6 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:55.528182 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-70291cc8-df12-45bf-919f-cb5370f694e6 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:55.536184 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-70291cc8-df12-45bf-919f-cb5370f694e6 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1553 microversion: 2.1 time: 0.165915 Jul 31 14:23:55.536805 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 77/169] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:55 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:55.681484 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f437a54d-5f90-485b-8d83-255453ee234e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:55.682007 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f437a54d-5f90-485b-8d83-255453ee234e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:55.688583 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f437a54d-5f90-485b-8d83-255453ee234e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:55.689027 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f437a54d-5f90-485b-8d83-255453ee234e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:55.689784 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f437a54d-5f90-485b-8d83-255453ee234e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:55.690268 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f437a54d-5f90-485b-8d83-255453ee234e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:55.819341 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f437a54d-5f90-485b-8d83-255453ee234e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:55.827121 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f437a54d-5f90-485b-8d83-255453ee234e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.149616 Jul 31 14:23:55.827720 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 93/170] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:55 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:55.835832 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-a37f2928-fb81-479f-96dc-257bc31e1860 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:55.836441 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-a37f2928-fb81-479f-96dc-257bc31e1860 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:55.842935 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a37f2928-fb81-479f-96dc-257bc31e1860 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:55.843389 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a37f2928-fb81-479f-96dc-257bc31e1860 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:55.844260 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a37f2928-fb81-479f-96dc-257bc31e1860 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:55.844612 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a37f2928-fb81-479f-96dc-257bc31e1860 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:55.988286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a37f2928-fb81-479f-96dc-257bc31e1860 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:56.002601 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-a37f2928-fb81-479f-96dc-257bc31e1860 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72" status: 200 len: 1314 microversion: 2.1 time: 0.170769 Jul 31 14:23:56.003412 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 78/171] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:55 2022] GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:56.064957 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-81df3bc8-a3f1-499a-84c9-20ec22787365 req-208f040c-18ee-4096-ad7e-f4b16bda942e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5946aed-8d23-4b14-b806-c62c21468d72", "name": "network-vif-plugged", "status": "completed", "tag": "d3ccc265-c1e6-4590-bdce-3c7fcebbe512"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:23:56.078713 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-81df3bc8-a3f1-499a-84c9-20ec22787365 req-208f040c-18ee-4096-ad7e-f4b16bda942e service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:56.079162 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-81df3bc8-a3f1-499a-84c9-20ec22787365 req-208f040c-18ee-4096-ad7e-f4b16bda942e service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:56.094409 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-81df3bc8-a3f1-499a-84c9-20ec22787365 req-208f040c-18ee-4096-ad7e-f4b16bda942e service nova] Creating event network-vif-plugged:d3ccc265-c1e6-4590-bdce-3c7fcebbe512 for instance e5946aed-8d23-4b14-b806-c62c21468d72 on hv-cinder-84984 Jul 31 14:23:56.101808 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-81df3bc8-a3f1-499a-84c9-20ec22787365 req-208f040c-18ee-4096-ad7e-f4b16bda942e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040781 Jul 31 14:23:56.102602 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 94/172] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:23:56.557993 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-04914411-62f8-40ca-92f2-ac0925ae9904 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:56.558604 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-04914411-62f8-40ca-92f2-ac0925ae9904 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:56.565597 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-04914411-62f8-40ca-92f2-ac0925ae9904 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:56.566045 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-04914411-62f8-40ca-92f2-ac0925ae9904 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:56.567017 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-04914411-62f8-40ca-92f2-ac0925ae9904 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:56.567481 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-04914411-62f8-40ca-92f2-ac0925ae9904 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:56.811745 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-04914411-62f8-40ca-92f2-ac0925ae9904 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:56.821150 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-04914411-62f8-40ca-92f2-ac0925ae9904 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1553 microversion: 2.1 time: 0.266834 Jul 31 14:23:56.822450 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 79/173] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:56 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1553 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:56.850498 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-43c47383-72b0-4c7d-a013-f7b9091c9b3e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:56.851987 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-43c47383-72b0-4c7d-a013-f7b9091c9b3e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:56.859520 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-43c47383-72b0-4c7d-a013-f7b9091c9b3e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:56.860158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-43c47383-72b0-4c7d-a013-f7b9091c9b3e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:56.861282 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-43c47383-72b0-4c7d-a013-f7b9091c9b3e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:56.861717 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-43c47383-72b0-4c7d-a013-f7b9091c9b3e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:56.866741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:23:57.025131 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7fe4fded-c987-40ca-8315-2ac0e1604126 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:57.025745 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7fe4fded-c987-40ca-8315-2ac0e1604126 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:57.032205 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7fe4fded-c987-40ca-8315-2ac0e1604126 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:57.032882 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7fe4fded-c987-40ca-8315-2ac0e1604126 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:57.033879 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7fe4fded-c987-40ca-8315-2ac0e1604126 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:57.034913 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7fe4fded-c987-40ca-8315-2ac0e1604126 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:57.067506 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-43c47383-72b0-4c7d-a013-f7b9091c9b3e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:57.076441 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-43c47383-72b0-4c7d-a013-f7b9091c9b3e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.231732 Jul 31 14:23:57.077807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 95/174] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:56 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:57.240995 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7fe4fded-c987-40ca-8315-2ac0e1604126 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:57.253653 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7fe4fded-c987-40ca-8315-2ac0e1604126 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72" status: 200 len: 1314 microversion: 2.1 time: 0.232723 Jul 31 14:23:57.254217 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 80/175] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:57 2022] GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:57.842441 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4315d077-a879-4595-a5e1-42f481e54ffb tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:57.843056 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4315d077-a879-4595-a5e1-42f481e54ffb tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:57.851313 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4315d077-a879-4595-a5e1-42f481e54ffb tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:57.851864 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4315d077-a879-4595-a5e1-42f481e54ffb tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:57.852541 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4315d077-a879-4595-a5e1-42f481e54ffb tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:57.852978 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4315d077-a879-4595-a5e1-42f481e54ffb tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:58.098475 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-28be2d7f-bc27-4f65-9863-90c5db6c07c4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:58.099700 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-28be2d7f-bc27-4f65-9863-90c5db6c07c4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:58.102510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4315d077-a879-4595-a5e1-42f481e54ffb tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:58.109475 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-28be2d7f-bc27-4f65-9863-90c5db6c07c4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:58.109942 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-28be2d7f-bc27-4f65-9863-90c5db6c07c4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:58.110728 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-28be2d7f-bc27-4f65-9863-90c5db6c07c4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:58.111171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-28be2d7f-bc27-4f65-9863-90c5db6c07c4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:58.120784 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4315d077-a879-4595-a5e1-42f481e54ffb tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1553 microversion: 2.1 time: 0.282240 Jul 31 14:23:58.135917 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 96/176] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:57 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1553 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:58.283631 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a9fa247a-725e-409e-91ed-750e5f6eb0fc tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:58.284464 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a9fa247a-725e-409e-91ed-750e5f6eb0fc tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:58.292622 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a9fa247a-725e-409e-91ed-750e5f6eb0fc tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:58.293919 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a9fa247a-725e-409e-91ed-750e5f6eb0fc tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:58.295795 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a9fa247a-725e-409e-91ed-750e5f6eb0fc tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:58.296384 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a9fa247a-725e-409e-91ed-750e5f6eb0fc tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:58.355074 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-28be2d7f-bc27-4f65-9863-90c5db6c07c4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:58.384578 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-28be2d7f-bc27-4f65-9863-90c5db6c07c4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.290282 Jul 31 14:23:58.387513 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 81/177] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:58 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:23:58.532609 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-56474b9b-536b-4897-86f9-dd59865122ea req-b3f61689-33f5-4323-9614-7260698e039f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c15a0e90-90b9-47be-a034-3de7757c7bcb", "name": "network-vif-deleted", "tag": "4e3565ba-9723-4b87-a1a4-bbb331da879d"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:23:58.547133 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a9fa247a-725e-409e-91ed-750e5f6eb0fc tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:58.548908 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-56474b9b-536b-4897-86f9-dd59865122ea req-b3f61689-33f5-4323-9614-7260698e039f service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:58.550575 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-56474b9b-536b-4897-86f9-dd59865122ea req-b3f61689-33f5-4323-9614-7260698e039f service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:58.555477 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a9fa247a-725e-409e-91ed-750e5f6eb0fc tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72" status: 200 len: 1314 microversion: 2.1 time: 0.280415 Jul 31 14:23:58.556458 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 97/178] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:58 2022] GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:58.562127 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:23:58.578258 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-56474b9b-536b-4897-86f9-dd59865122ea req-b3f61689-33f5-4323-9614-7260698e039f service nova] Creating event network-vif-deleted:4e3565ba-9723-4b87-a1a4-bbb331da879d for instance c15a0e90-90b9-47be-a034-3de7757c7bcb on hv-cinder-84984 Jul 31 14:23:58.585451 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-56474b9b-536b-4897-86f9-dd59865122ea req-b3f61689-33f5-4323-9614-7260698e039f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056184 Jul 31 14:23:58.586994 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 82/179] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:23:59.141777 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a424a0cd-be14-4e2d-a3e9-17c38f4b2bd4 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:59.142490 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a424a0cd-be14-4e2d-a3e9-17c38f4b2bd4 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:59.149864 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a424a0cd-be14-4e2d-a3e9-17c38f4b2bd4 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:59.150335 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a424a0cd-be14-4e2d-a3e9-17c38f4b2bd4 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:59.151114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a424a0cd-be14-4e2d-a3e9-17c38f4b2bd4 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:59.151579 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a424a0cd-be14-4e2d-a3e9-17c38f4b2bd4 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:59.219935 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a424a0cd-be14-4e2d-a3e9-17c38f4b2bd4 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db0c001088aa4c86b4562c369deb6c46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4ef4d34a8114051a67c51e01cb2b8eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:59.230684 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a424a0cd-be14-4e2d-a3e9-17c38f4b2bd4 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 200 len: 1345 microversion: 2.1 time: 0.092610 Jul 31 14:23:59.231268 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 98/180] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:59 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 1345 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:59.412479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-3c994b78-f9e3-479f-b4be-3cd175642b7a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:59.414094 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-3c994b78-f9e3-479f-b4be-3cd175642b7a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:59.421112 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3c994b78-f9e3-479f-b4be-3cd175642b7a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:59.421913 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3c994b78-f9e3-479f-b4be-3cd175642b7a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:59.422978 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3c994b78-f9e3-479f-b4be-3cd175642b7a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:59.423794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3c994b78-f9e3-479f-b4be-3cd175642b7a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:59.576750 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-051bf098-f16e-4d23-96b3-a5849dc59e38 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:23:59.577605 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-051bf098-f16e-4d23-96b3-a5849dc59e38 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:23:59.584087 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-3c994b78-f9e3-479f-b4be-3cd175642b7a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:59.588223 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-051bf098-f16e-4d23-96b3-a5849dc59e38 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:59.589002 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-051bf098-f16e-4d23-96b3-a5849dc59e38 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:59.590595 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-051bf098-f16e-4d23-96b3-a5849dc59e38 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:23:59.591930 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-051bf098-f16e-4d23-96b3-a5849dc59e38 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:23:59.593877 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-3c994b78-f9e3-479f-b4be-3cd175642b7a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.187622 Jul 31 14:23:59.596109 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 83/181] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:59 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:23:59.781626 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-051bf098-f16e-4d23-96b3-a5849dc59e38 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:23:59.791177 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-051bf098-f16e-4d23-96b3-a5849dc59e38 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72" status: 200 len: 1498 microversion: 2.1 time: 0.218392 Jul 31 14:23:59.791860 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 99/182] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:23:59 2022] GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72 => generated 1498 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:00.252380 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-711e669d-e5ed-45af-b52b-b56443491ff7 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:00.252996 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-711e669d-e5ed-45af-b52b-b56443491ff7 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:00.259942 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-711e669d-e5ed-45af-b52b-b56443491ff7 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:00.260405 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-711e669d-e5ed-45af-b52b-b56443491ff7 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:00.261186 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-711e669d-e5ed-45af-b52b-b56443491ff7 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:00.261622 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-711e669d-e5ed-45af-b52b-b56443491ff7 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:00.277563 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.wsgi [None req-711e669d-e5ed-45af-b52b-b56443491ff7 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] HTTP exception thrown: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. Jul 31 14:24:00.282655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-711e669d-e5ed-45af-b52b-b56443491ff7 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Request method failure captured: Jul 31 14:24:00.282655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: request: GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb HTTP/1.1 Jul 31 14:24:00.282655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept: application/json Jul 31 14:24:00.282655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept-Encoding: identity Jul 31 14:24:00.282655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Connection: close Jul 31 14:24:00.282655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Length: 0 Jul 31 14:24:00.282655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Type: application/json Jul 31 14:24:00.282655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Host: 10.222.0.40 Jul 31 14:24:00.282655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Openstack-System-Scope: None Jul 31 14:24:00.282655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: User-Agent: python-urllib3/1.26.10 Jul 31 14:24:00.282655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Auth-Token: gAAAAABi5pBCmzMwIBb3Kb1h8B0sXWkadGSl3uLi6pPaATDPQnLXVqN_GpNCfyMR9Bj5UtZTuohIYpO-m5TcNGSwCVyZqv3a8Qviu-GiDdnDP-aF8J08TtoOvYDgF2zJ2WWTyOtGo5ECjhcvYsM3SCOCT85OVMvIghQD_CFfEjcTRKdcooMKGrI Jul 31 14:24:00.282655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Id: None Jul 31 14:24:00.282655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Name: None Jul 31 14:24:00.282655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Identity-Status: Confirmed Jul 31 14:24:00.282655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Is-Admin-Project: True Jul 31 14:24:00.282655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Id: default Jul 31 14:24:00.282655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Name: Default Jul 31 14:24:00.282655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Id: f4ef4d34a8114051a67c51e01cb2b8eb Jul 31 14:24:00.282655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Name: tempest-DeleteServersTestJSON-530228188 Jul 31 14:24:00.282655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Role: reader,member Jul 31 14:24:00.282655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Roles: reader,member Jul 31 14:24:00.284339 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4ef4d34a8114051a67c51e01cb2b8eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f4ef4d34a8114051a67c51e01cb2b8eb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f4ef4d34a8114051a67c51e01cb2b8eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4ef4d34a8114051a67c51e01cb2b8eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:24:00.284339 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant: tempest-DeleteServersTestJSON-530228188 Jul 31 14:24:00.284339 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Id: f4ef4d34a8114051a67c51e01cb2b8eb Jul 31 14:24:00.284339 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Name: tempest-DeleteServersTestJSON-530228188 Jul 31 14:24:00.284339 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User: tempest-DeleteServersTestJSON-530228188-project Jul 31 14:24:00.284339 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Id: default Jul 31 14:24:00.284339 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Name: Default Jul 31 14:24:00.284339 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Id: db0c001088aa4c86b4562c369deb6c46 Jul 31 14:24:00.284339 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Name: tempest-DeleteServersTestJSON-530228188-project Jul 31 14:24:00.284339 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: method: > Jul 31 14:24:00.284339 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: exception: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. Jul 31 14:24:00.284339 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: action_args: {'id': 'c15a0e90-90b9-47be-a034-3de7757c7bcb'} Jul 31 14:24:00.285317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:24:00.285317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:00.285317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:24:00.285317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:24:00.285317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:24:00.285317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:24:00.285317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:24:00.285317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:24:00.285317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:24:00.285317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:24:00.285317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. Jul 31 14:24:00.285317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:24:00.285317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:00.285317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:24:00.285317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:00.285317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:24:00.285317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:24:00.285317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:24:00.285317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:24:00.285317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:24:00.287011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:24:00.287011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:24:00.287011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:24:00.287011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:24:00.287011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:24:00.287011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:24:00.287011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:24:00.287011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. Jul 31 14:24:00.287011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:24:00.287011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:00.287011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:24:00.287011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:00.287011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:24:00.287011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:24:00.287011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:24:00.287011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:24:00.287011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. Jul 31 14:24:00.287011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:24:00.288040 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-711e669d-e5ed-45af-b52b-b56443491ff7 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Returning 404 to user: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. {{(pid=117781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:24:00.288040 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-711e669d-e5ed-45af-b52b-b56443491ff7 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 404 len: 111 microversion: 2.1 time: 0.035661 Jul 31 14:24:00.297806 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 84/183] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:00 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:24:00.465544 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ba89d66e-7fcf-4fbc-9ce4-963e4e8b0c74 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:00.470288 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ba89d66e-7fcf-4fbc-9ce4-963e4e8b0c74 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:00.480136 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ba89d66e-7fcf-4fbc-9ce4-963e4e8b0c74 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:00.480823 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ba89d66e-7fcf-4fbc-9ce4-963e4e8b0c74 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:00.481823 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ba89d66e-7fcf-4fbc-9ce4-963e4e8b0c74 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:00.482441 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ba89d66e-7fcf-4fbc-9ce4-963e4e8b0c74 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:00.496824 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-ba89d66e-7fcf-4fbc-9ce4-963e4e8b0c74 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] HTTP exception thrown: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. Jul 31 14:24:00.502179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ba89d66e-7fcf-4fbc-9ce4-963e4e8b0c74 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Request method failure captured: Jul 31 14:24:00.502179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb/os-volume_attachments HTTP/1.1 Jul 31 14:24:00.502179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:24:00.502179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:24:00.502179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:24:00.502179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:24:00.502179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:24:00.502179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:24:00.502179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:24:00.502179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:24:00.502179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pBCmzMwIBb3Kb1h8B0sXWkadGSl3uLi6pPaATDPQnLXVqN_GpNCfyMR9Bj5UtZTuohIYpO-m5TcNGSwCVyZqv3a8Qviu-GiDdnDP-aF8J08TtoOvYDgF2zJ2WWTyOtGo5ECjhcvYsM3SCOCT85OVMvIghQD_CFfEjcTRKdcooMKGrI Jul 31 14:24:00.502179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:24:00.502179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:24:00.502179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:24:00.502179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:24:00.502179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:24:00.502179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:24:00.502179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: f4ef4d34a8114051a67c51e01cb2b8eb Jul 31 14:24:00.502179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-DeleteServersTestJSON-530228188 Jul 31 14:24:00.502179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:24:00.502179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:24:00.503477 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4ef4d34a8114051a67c51e01cb2b8eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f4ef4d34a8114051a67c51e01cb2b8eb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f4ef4d34a8114051a67c51e01cb2b8eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4ef4d34a8114051a67c51e01cb2b8eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:24:00.503477 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-DeleteServersTestJSON-530228188 Jul 31 14:24:00.503477 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: f4ef4d34a8114051a67c51e01cb2b8eb Jul 31 14:24:00.503477 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-DeleteServersTestJSON-530228188 Jul 31 14:24:00.503477 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-DeleteServersTestJSON-530228188-project Jul 31 14:24:00.503477 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:24:00.503477 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:24:00.503477 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: db0c001088aa4c86b4562c369deb6c46 Jul 31 14:24:00.503477 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-DeleteServersTestJSON-530228188-project Jul 31 14:24:00.503477 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:24:00.503477 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. Jul 31 14:24:00.503477 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'server_id': 'c15a0e90-90b9-47be-a034-3de7757c7bcb'} Jul 31 14:24:00.504124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:24:00.504124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:00.504124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:24:00.504124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:24:00.504124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:24:00.504124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:24:00.504124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:24:00.504124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:24:00.504124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:24:00.504124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:24:00.504124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. Jul 31 14:24:00.504124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:00.504124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:00.504124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:00.504124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:00.504124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:24:00.504124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:24:00.504124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:24:00.504124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:24:00.504124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:24:00.505241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:24:00.505241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 14:24:00.505241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 14:24:00.505241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 31 14:24:00.505241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 14:24:00.505241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 31 14:24:00.505241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 31 14:24:00.505241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:24:00.505241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:24:00.505241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. Jul 31 14:24:00.505241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:00.505241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:00.505241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:00.505241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:00.505241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:24:00.505241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:24:00.505241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:24:00.505241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:24:00.505241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. Jul 31 14:24:00.505241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:00.509270 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ba89d66e-7fcf-4fbc-9ce4-963e4e8b0c74 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Returning 404 to user: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:24:00.511228 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ba89d66e-7fcf-4fbc-9ce4-963e4e8b0c74 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050138 Jul 31 14:24:00.515407 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 100/184] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Jul 31 14:24:00 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb/os-volume_attachments => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:24:00.543930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-cbaaeddb-c5e3-4318-bd9e-723c1fece693 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:00.544458 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-cbaaeddb-c5e3-4318-bd9e-723c1fece693 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:00.556072 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-cbaaeddb-c5e3-4318-bd9e-723c1fece693 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:00.556750 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-cbaaeddb-c5e3-4318-bd9e-723c1fece693 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:00.558035 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-cbaaeddb-c5e3-4318-bd9e-723c1fece693 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:00.558484 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-cbaaeddb-c5e3-4318-bd9e-723c1fece693 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:00.590308 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-cbaaeddb-c5e3-4318-bd9e-723c1fece693 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] Going to try to terminate instance {{(pid=117781) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 14:24:00.619678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-15020635-0c24-4876-992a-7c721557c25e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:00.620446 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-15020635-0c24-4876-992a-7c721557c25e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:00.628054 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-15020635-0c24-4876-992a-7c721557c25e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:00.635683 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-15020635-0c24-4876-992a-7c721557c25e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:00.636829 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-15020635-0c24-4876-992a-7c721557c25e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:00.637424 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-15020635-0c24-4876-992a-7c721557c25e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:00.769893 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-cbaaeddb-c5e3-4318-bd9e-723c1fece693 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72" status: 204 len: 0 microversion: 2.1 time: 0.229795 Jul 31 14:24:00.771234 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 85/185] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:24:00 2022] DELETE /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 14:24:00.780838 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-950a1251-0e5b-4779-b738-878e1d21093e tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:00.781551 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-950a1251-0e5b-4779-b738-878e1d21093e tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:00.794484 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-950a1251-0e5b-4779-b738-878e1d21093e tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:00.800617 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-950a1251-0e5b-4779-b738-878e1d21093e tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:00.801684 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-950a1251-0e5b-4779-b738-878e1d21093e tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:00.803624 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-950a1251-0e5b-4779-b738-878e1d21093e tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:00.920661 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-15020635-0c24-4876-992a-7c721557c25e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:00.929500 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-15020635-0c24-4876-992a-7c721557c25e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.313728 Jul 31 14:24:00.930074 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 101/186] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:00 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:24:01.296399 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-950a1251-0e5b-4779-b738-878e1d21093e tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:01.313698 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-950a1251-0e5b-4779-b738-878e1d21093e tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72" status: 200 len: 1504 microversion: 2.1 time: 0.537273 Jul 31 14:24:01.314321 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 86/187] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:00 2022] GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72 => generated 1504 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:01.858980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-64d13b5c-744f-4e47-b483-61de5090fc12 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:01.860395 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-64d13b5c-744f-4e47-b483-61de5090fc12 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:01.869339 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-64d13b5c-744f-4e47-b483-61de5090fc12 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:01.869568 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-64d13b5c-744f-4e47-b483-61de5090fc12 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:01.871118 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-64d13b5c-744f-4e47-b483-61de5090fc12 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:01.872147 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-64d13b5c-744f-4e47-b483-61de5090fc12 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:01.891995 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-64d13b5c-744f-4e47-b483-61de5090fc12 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] HTTP exception thrown: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. Jul 31 14:24:01.896452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-64d13b5c-744f-4e47-b483-61de5090fc12 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Request method failure captured: Jul 31 14:24:01.896452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: DELETE /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb HTTP/1.1 Jul 31 14:24:01.896452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:24:01.896452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:24:01.896452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:24:01.896452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:24:01.896452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:24:01.896452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:24:01.896452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:24:01.896452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:24:01.896452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pBCmzMwIBb3Kb1h8B0sXWkadGSl3uLi6pPaATDPQnLXVqN_GpNCfyMR9Bj5UtZTuohIYpO-m5TcNGSwCVyZqv3a8Qviu-GiDdnDP-aF8J08TtoOvYDgF2zJ2WWTyOtGo5ECjhcvYsM3SCOCT85OVMvIghQD_CFfEjcTRKdcooMKGrI Jul 31 14:24:01.896452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:24:01.896452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:24:01.896452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:24:01.896452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:24:01.896452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:24:01.896452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:24:01.896452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: f4ef4d34a8114051a67c51e01cb2b8eb Jul 31 14:24:01.896452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-DeleteServersTestJSON-530228188 Jul 31 14:24:01.896452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:24:01.896452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:24:01.897760 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4ef4d34a8114051a67c51e01cb2b8eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f4ef4d34a8114051a67c51e01cb2b8eb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f4ef4d34a8114051a67c51e01cb2b8eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4ef4d34a8114051a67c51e01cb2b8eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:24:01.897760 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-DeleteServersTestJSON-530228188 Jul 31 14:24:01.897760 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: f4ef4d34a8114051a67c51e01cb2b8eb Jul 31 14:24:01.897760 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-DeleteServersTestJSON-530228188 Jul 31 14:24:01.897760 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-DeleteServersTestJSON-530228188-project Jul 31 14:24:01.897760 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:24:01.897760 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:24:01.897760 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: db0c001088aa4c86b4562c369deb6c46 Jul 31 14:24:01.897760 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-DeleteServersTestJSON-530228188-project Jul 31 14:24:01.897760 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:24:01.897760 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. Jul 31 14:24:01.897760 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': 'c15a0e90-90b9-47be-a034-3de7757c7bcb'} Jul 31 14:24:01.898433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:24:01.898433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:01.898433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:24:01.898433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:24:01.898433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:24:01.898433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:24:01.898433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:24:01.898433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:24:01.898433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:24:01.898433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:24:01.898433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. Jul 31 14:24:01.898433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:01.898433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:01.898433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:01.898433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:01.898433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:24:01.898433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:24:01.898433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:24:01.898433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:24:01.898433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:24:01.903906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:24:01.903906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 14:24:01.903906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 14:24:01.903906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 14:24:01.903906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 14:24:01.903906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:24:01.903906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:24:01.903906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:24:01.903906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:24:01.903906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. Jul 31 14:24:01.903906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:01.903906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:01.903906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:01.903906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:01.903906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:24:01.903906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:24:01.903906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:24:01.903906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:24:01.903906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. Jul 31 14:24:01.903906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:01.905447 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-64d13b5c-744f-4e47-b483-61de5090fc12 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Returning 404 to user: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:24:01.905447 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-64d13b5c-744f-4e47-b483-61de5090fc12 tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "DELETE /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 404 len: 111 microversion: 2.1 time: 0.044166 Jul 31 14:24:01.905447 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 102/188] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:24:01 2022] DELETE /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:24:01.909693 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-8ea0a171-c1ff-489e-a103-c45c54cbf65c tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:01.910453 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-8ea0a171-c1ff-489e-a103-c45c54cbf65c tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] [instance: c15a0e90-90b9-47be-a034-3de7757c7bcb] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:01.918226 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8ea0a171-c1ff-489e-a103-c45c54cbf65c tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:01.918710 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8ea0a171-c1ff-489e-a103-c45c54cbf65c tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:01.919590 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8ea0a171-c1ff-489e-a103-c45c54cbf65c tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:01.920065 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8ea0a171-c1ff-489e-a103-c45c54cbf65c tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:01.951276 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-829b1b44-7339-4c1f-86be-07e6a8e9e54f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:01.952018 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-829b1b44-7339-4c1f-86be-07e6a8e9e54f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:01.959173 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-829b1b44-7339-4c1f-86be-07e6a8e9e54f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:01.959945 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-829b1b44-7339-4c1f-86be-07e6a8e9e54f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:01.960984 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-829b1b44-7339-4c1f-86be-07e6a8e9e54f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:01.961603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-829b1b44-7339-4c1f-86be-07e6a8e9e54f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:01.964057 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.wsgi [None req-8ea0a171-c1ff-489e-a103-c45c54cbf65c tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] HTTP exception thrown: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. Jul 31 14:24:01.966027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-8ea0a171-c1ff-489e-a103-c45c54cbf65c tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Request method failure captured: Jul 31 14:24:01.966027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: request: GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb HTTP/1.1 Jul 31 14:24:01.966027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept: application/json Jul 31 14:24:01.966027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept-Encoding: identity Jul 31 14:24:01.966027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Connection: close Jul 31 14:24:01.966027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Length: 0 Jul 31 14:24:01.966027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Type: application/json Jul 31 14:24:01.966027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Host: 10.222.0.40 Jul 31 14:24:01.966027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Openstack-System-Scope: None Jul 31 14:24:01.966027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: User-Agent: python-urllib3/1.26.10 Jul 31 14:24:01.966027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Auth-Token: gAAAAABi5pBCmzMwIBb3Kb1h8B0sXWkadGSl3uLi6pPaATDPQnLXVqN_GpNCfyMR9Bj5UtZTuohIYpO-m5TcNGSwCVyZqv3a8Qviu-GiDdnDP-aF8J08TtoOvYDgF2zJ2WWTyOtGo5ECjhcvYsM3SCOCT85OVMvIghQD_CFfEjcTRKdcooMKGrI Jul 31 14:24:01.966027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Id: None Jul 31 14:24:01.966027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Name: None Jul 31 14:24:01.966027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Identity-Status: Confirmed Jul 31 14:24:01.966027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Is-Admin-Project: True Jul 31 14:24:01.966027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Id: default Jul 31 14:24:01.966027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Name: Default Jul 31 14:24:01.966027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Id: f4ef4d34a8114051a67c51e01cb2b8eb Jul 31 14:24:01.966027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Name: tempest-DeleteServersTestJSON-530228188 Jul 31 14:24:01.966027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Role: reader,member Jul 31 14:24:01.966027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Roles: reader,member Jul 31 14:24:01.967191 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4ef4d34a8114051a67c51e01cb2b8eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_f4ef4d34a8114051a67c51e01cb2b8eb", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/f4ef4d34a8114051a67c51e01cb2b8eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/f4ef4d34a8114051a67c51e01cb2b8eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:24:01.967191 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant: tempest-DeleteServersTestJSON-530228188 Jul 31 14:24:01.967191 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Id: f4ef4d34a8114051a67c51e01cb2b8eb Jul 31 14:24:01.967191 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Name: tempest-DeleteServersTestJSON-530228188 Jul 31 14:24:01.967191 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User: tempest-DeleteServersTestJSON-530228188-project Jul 31 14:24:01.967191 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Id: default Jul 31 14:24:01.967191 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Name: Default Jul 31 14:24:01.967191 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Id: db0c001088aa4c86b4562c369deb6c46 Jul 31 14:24:01.967191 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Name: tempest-DeleteServersTestJSON-530228188-project Jul 31 14:24:01.967191 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: method: > Jul 31 14:24:01.967191 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: exception: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. Jul 31 14:24:01.967191 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: action_args: {'id': 'c15a0e90-90b9-47be-a034-3de7757c7bcb'} Jul 31 14:24:01.968197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:24:01.968197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:01.968197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:24:01.968197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:24:01.968197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:24:01.968197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:24:01.968197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:24:01.968197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:24:01.968197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:24:01.968197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:24:01.968197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. Jul 31 14:24:01.968197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:24:01.968197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:01.968197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:24:01.968197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:01.968197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:24:01.968197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:24:01.968197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:24:01.968197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:24:01.968197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:24:01.969243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:24:01.969243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:24:01.969243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:24:01.969243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:24:01.969243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:24:01.969243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:24:01.969243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:24:01.969243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. Jul 31 14:24:01.969243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:24:01.969243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:01.969243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:24:01.969243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:01.969243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:24:01.969243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:24:01.969243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:24:01.969243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:24:01.969243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. Jul 31 14:24:01.969243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:24:01.970165 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-8ea0a171-c1ff-489e-a103-c45c54cbf65c tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] Returning 404 to user: Instance c15a0e90-90b9-47be-a034-3de7757c7bcb could not be found. {{(pid=117781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:24:01.970165 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-8ea0a171-c1ff-489e-a103-c45c54cbf65c tempest-DeleteServersTestJSON-530228188 tempest-DeleteServersTestJSON-530228188-project] 10.222.0.40 "GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb" status: 404 len: 111 microversion: 2.1 time: 0.063384 Jul 31 14:24:01.970165 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 87/189] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:01 2022] GET /compute/v2.1/servers/c15a0e90-90b9-47be-a034-3de7757c7bcb => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:24:02.245786 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-829b1b44-7339-4c1f-86be-07e6a8e9e54f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:02.253352 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-829b1b44-7339-4c1f-86be-07e6a8e9e54f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.307273 Jul 31 14:24:02.253921 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 103/190] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:01 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:02.340088 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-2553d922-45d1-4913-8763-36b7d6e4c0db tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:02.340795 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-2553d922-45d1-4913-8763-36b7d6e4c0db tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:02.346818 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2553d922-45d1-4913-8763-36b7d6e4c0db tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:02.347340 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2553d922-45d1-4913-8763-36b7d6e4c0db tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:02.348138 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2553d922-45d1-4913-8763-36b7d6e4c0db tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:02.348576 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2553d922-45d1-4913-8763-36b7d6e4c0db tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:02.504991 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-2553d922-45d1-4913-8763-36b7d6e4c0db tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:02.517070 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-2553d922-45d1-4913-8763-36b7d6e4c0db tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72" status: 200 len: 1504 microversion: 2.1 time: 0.178872 Jul 31 14:24:02.518653 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 88/191] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:02 2022] GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72 => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:03.249051 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-5496c593-631a-492d-84fd-bdf7d8a30b91 req-a7ca67fc-1253-4b88-bf97-53c846c8a8de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5946aed-8d23-4b14-b806-c62c21468d72", "name": "network-vif-deleted", "tag": "d3ccc265-c1e6-4590-bdce-3c7fcebbe512"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:24:03.270236 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-5496c593-631a-492d-84fd-bdf7d8a30b91 req-a7ca67fc-1253-4b88-bf97-53c846c8a8de service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:03.271448 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-5496c593-631a-492d-84fd-bdf7d8a30b91 req-a7ca67fc-1253-4b88-bf97-53c846c8a8de service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:03.275531 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-d8b29075-7810-414c-aab0-14913dc70dec tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:03.276285 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-d8b29075-7810-414c-aab0-14913dc70dec tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:03.283063 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d8b29075-7810-414c-aab0-14913dc70dec tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:03.283629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d8b29075-7810-414c-aab0-14913dc70dec tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:03.284650 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d8b29075-7810-414c-aab0-14913dc70dec tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:03.285166 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d8b29075-7810-414c-aab0-14913dc70dec tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:03.285571 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-5496c593-631a-492d-84fd-bdf7d8a30b91 req-a7ca67fc-1253-4b88-bf97-53c846c8a8de service nova] Creating event network-vif-deleted:d3ccc265-c1e6-4590-bdce-3c7fcebbe512 for instance e5946aed-8d23-4b14-b806-c62c21468d72 on hv-cinder-84984 Jul 31 14:24:03.291250 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-5496c593-631a-492d-84fd-bdf7d8a30b91 req-a7ca67fc-1253-4b88-bf97-53c846c8a8de service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047172 Jul 31 14:24:03.292202 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 104/192] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:24:03.465822 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-d8b29075-7810-414c-aab0-14913dc70dec tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:03.474950 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-d8b29075-7810-414c-aab0-14913dc70dec tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.204618 Jul 31 14:24:03.475898 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 89/193] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:03 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:03.541149 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e3ec6d5f-ad86-45f6-8c0f-5857684c4992 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:03.542014 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e3ec6d5f-ad86-45f6-8c0f-5857684c4992 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:03.548657 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e3ec6d5f-ad86-45f6-8c0f-5857684c4992 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:03.549107 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e3ec6d5f-ad86-45f6-8c0f-5857684c4992 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:03.550073 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e3ec6d5f-ad86-45f6-8c0f-5857684c4992 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:03.550448 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e3ec6d5f-ad86-45f6-8c0f-5857684c4992 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:03.665352 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e3ec6d5f-ad86-45f6-8c0f-5857684c4992 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:03.675452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e3ec6d5f-ad86-45f6-8c0f-5857684c4992 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72" status: 200 len: 1462 microversion: 2.1 time: 0.139889 Jul 31 14:24:03.676286 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 105/194] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:03 2022] GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72 => generated 1462 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:04.512361 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b3e7e5d0-4bf5-4255-8e79-181ef9a33036 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:04.513062 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b3e7e5d0-4bf5-4255-8e79-181ef9a33036 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:04.525688 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b3e7e5d0-4bf5-4255-8e79-181ef9a33036 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:04.526207 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b3e7e5d0-4bf5-4255-8e79-181ef9a33036 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:04.526994 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b3e7e5d0-4bf5-4255-8e79-181ef9a33036 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:04.527710 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b3e7e5d0-4bf5-4255-8e79-181ef9a33036 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:04.697106 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-619a347b-070e-49da-a000-6ac5ca67ec0f tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:04.697718 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-619a347b-070e-49da-a000-6ac5ca67ec0f tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:04.706220 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-619a347b-070e-49da-a000-6ac5ca67ec0f tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:04.706668 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-619a347b-070e-49da-a000-6ac5ca67ec0f tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:04.707640 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-619a347b-070e-49da-a000-6ac5ca67ec0f tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:04.718759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-619a347b-070e-49da-a000-6ac5ca67ec0f tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:04.749706 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b3e7e5d0-4bf5-4255-8e79-181ef9a33036 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:04.763744 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b3e7e5d0-4bf5-4255-8e79-181ef9a33036 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.269537 Jul 31 14:24:04.766486 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 90/195] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:04 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:04.814129 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-619a347b-070e-49da-a000-6ac5ca67ec0f tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:04.821946 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-619a347b-070e-49da-a000-6ac5ca67ec0f tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72" status: 200 len: 1299 microversion: 2.1 time: 0.128607 Jul 31 14:24:04.822647 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 106/196] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:04 2022] GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72 => generated 1299 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:05.797007 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-31bb2f12-aa86-4499-ae18-ce1c145c13b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:05.799801 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-31bb2f12-aa86-4499-ae18-ce1c145c13b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:05.814262 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-31bb2f12-aa86-4499-ae18-ce1c145c13b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:05.815471 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-31bb2f12-aa86-4499-ae18-ce1c145c13b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:05.817060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-31bb2f12-aa86-4499-ae18-ce1c145c13b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:05.818920 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-31bb2f12-aa86-4499-ae18-ce1c145c13b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:05.849106 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a14b1e16-45e2-4ef5-b958-756054cf796c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:05.850414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a14b1e16-45e2-4ef5-b958-756054cf796c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:05.861753 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a14b1e16-45e2-4ef5-b958-756054cf796c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:05.862729 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a14b1e16-45e2-4ef5-b958-756054cf796c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:05.863965 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a14b1e16-45e2-4ef5-b958-756054cf796c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:05.865175 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a14b1e16-45e2-4ef5-b958-756054cf796c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:05.928607 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a14b1e16-45e2-4ef5-b958-756054cf796c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:05.929344 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a14b1e16-45e2-4ef5-b958-756054cf796c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:05.930431 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-a14b1e16-45e2-4ef5-b958-756054cf796c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lazy-loading 'fault' on Instance uuid e5946aed-8d23-4b14-b806-c62c21468d72 {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:24:06.010153 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a14b1e16-45e2-4ef5-b958-756054cf796c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:06.029070 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a14b1e16-45e2-4ef5-b958-756054cf796c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72" status: 200 len: 1304 microversion: 2.1 time: 0.186465 Jul 31 14:24:06.033786 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 107/197] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:05 2022] GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72 => generated 1304 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:24:06.088872 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-31bb2f12-aa86-4499-ae18-ce1c145c13b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:06.096517 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-31bb2f12-aa86-4499-ae18-ce1c145c13b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.313083 Jul 31 14:24:06.097104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 91/198] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:05 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:07.054596 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1bc1f3f4-e686-4c62-bab9-bc744e400c78 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:07.055241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1bc1f3f4-e686-4c62-bab9-bc744e400c78 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:07.061819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1bc1f3f4-e686-4c62-bab9-bc744e400c78 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:07.062271 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1bc1f3f4-e686-4c62-bab9-bc744e400c78 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:07.063034 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1bc1f3f4-e686-4c62-bab9-bc744e400c78 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:07.063508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1bc1f3f4-e686-4c62-bab9-bc744e400c78 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:07.095628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1bc1f3f4-e686-4c62-bab9-bc744e400c78 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:07.096082 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1bc1f3f4-e686-4c62-bab9-bc744e400c78 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:07.096528 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-1bc1f3f4-e686-4c62-bab9-bc744e400c78 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lazy-loading 'fault' on Instance uuid e5946aed-8d23-4b14-b806-c62c21468d72 {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:24:07.117819 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-68536a38-90aa-4a3c-8b03-e3a3d194b627 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:07.119147 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-68536a38-90aa-4a3c-8b03-e3a3d194b627 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:07.125973 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-68536a38-90aa-4a3c-8b03-e3a3d194b627 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:07.126431 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-68536a38-90aa-4a3c-8b03-e3a3d194b627 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:07.127192 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-68536a38-90aa-4a3c-8b03-e3a3d194b627 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:07.127653 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-68536a38-90aa-4a3c-8b03-e3a3d194b627 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:07.150842 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1bc1f3f4-e686-4c62-bab9-bc744e400c78 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:07.158993 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1bc1f3f4-e686-4c62-bab9-bc744e400c78 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72" status: 200 len: 1304 microversion: 2.1 time: 0.108721 Jul 31 14:24:07.159589 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 108/199] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:07 2022] GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:07.266774 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-68536a38-90aa-4a3c-8b03-e3a3d194b627 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:07.274714 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-68536a38-90aa-4a3c-8b03-e3a3d194b627 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.161166 Jul 31 14:24:07.275280 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 92/200] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:07 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:24:07.648067 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-24f1fd5f-1145-4de7-beaf-8875de9a2b32 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Action: 'create', calling method: .version_select at 0x7f87e9b34280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-708961778"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:24:07.936300 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-24f1fd5f-1145-4de7-beaf-8875de9a2b32 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] 10.222.0.40 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.404346 Jul 31 14:24:07.936915 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 109/201] 10.222.0.40 () {60 vars in 1155 bytes} [Sun Jul 31 14:24:07 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 406 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 31 14:24:07.949481 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-cd8025f1-88f6-4245-9877-5dae6c618431 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Calling method '.version_select at 0x7f87e9d51160>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:08.010849 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-cd8025f1-88f6-4245-9877-5dae6c618431 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/88892192-07d4-4cfc-9a7a-6c6f5a30b212" status: 200 len: 344 microversion: 2.1 time: 0.065052 Jul 31 14:24:08.011438 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 93/202] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Jul 31 14:24:07 2022] GET /compute/v2.1/os-volumes/88892192-07d4-4cfc-9a7a-6c6f5a30b212 => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:24:08.180392 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4602e181-6a65-409a-8f0b-4cb93987391d tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:08.181003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4602e181-6a65-409a-8f0b-4cb93987391d tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:08.187716 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4602e181-6a65-409a-8f0b-4cb93987391d tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:08.188168 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4602e181-6a65-409a-8f0b-4cb93987391d tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:08.188927 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4602e181-6a65-409a-8f0b-4cb93987391d tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:08.189395 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4602e181-6a65-409a-8f0b-4cb93987391d tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:08.218634 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4602e181-6a65-409a-8f0b-4cb93987391d tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:08.219013 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4602e181-6a65-409a-8f0b-4cb93987391d tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:08.219482 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-4602e181-6a65-409a-8f0b-4cb93987391d tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lazy-loading 'fault' on Instance uuid e5946aed-8d23-4b14-b806-c62c21468d72 {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:24:08.262517 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4602e181-6a65-409a-8f0b-4cb93987391d tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:08.269945 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4602e181-6a65-409a-8f0b-4cb93987391d tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72" status: 200 len: 1304 microversion: 2.1 time: 0.094515 Jul 31 14:24:08.270573 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 110/203] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:08 2022] GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:08.295570 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-6013ffd3-acd1-4290-b3d1-e5c23d55a6a7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:08.296179 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-6013ffd3-acd1-4290-b3d1-e5c23d55a6a7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:08.303091 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6013ffd3-acd1-4290-b3d1-e5c23d55a6a7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:08.303697 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6013ffd3-acd1-4290-b3d1-e5c23d55a6a7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:08.304494 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6013ffd3-acd1-4290-b3d1-e5c23d55a6a7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:08.304934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6013ffd3-acd1-4290-b3d1-e5c23d55a6a7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:08.430342 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-6013ffd3-acd1-4290-b3d1-e5c23d55a6a7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:08.437839 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-6013ffd3-acd1-4290-b3d1-e5c23d55a6a7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.146164 Jul 31 14:24:08.438680 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 94/204] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:08 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:09.025288 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d75de39b-2695-4408-a9e3-12c4105c8000 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Calling method '.version_select at 0x7f87e9b34790>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:09.073680 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d75de39b-2695-4408-a9e3-12c4105c8000 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/88892192-07d4-4cfc-9a7a-6c6f5a30b212" status: 200 len: 344 microversion: 2.1 time: 0.052640 Jul 31 14:24:09.074247 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 111/205] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Jul 31 14:24:09 2022] GET /compute/v2.1/os-volumes/88892192-07d4-4cfc-9a7a-6c6f5a30b212 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:24:09.296690 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-ef1a6854-9435-4b8f-9966-246cc38f6b51 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:09.297210 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-ef1a6854-9435-4b8f-9966-246cc38f6b51 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: e5946aed-8d23-4b14-b806-c62c21468d72] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:09.303105 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ef1a6854-9435-4b8f-9966-246cc38f6b51 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:09.303598 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ef1a6854-9435-4b8f-9966-246cc38f6b51 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:09.304894 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ef1a6854-9435-4b8f-9966-246cc38f6b51 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:09.305327 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ef1a6854-9435-4b8f-9966-246cc38f6b51 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:09.320763 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.wsgi [None req-ef1a6854-9435-4b8f-9966-246cc38f6b51 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] HTTP exception thrown: Instance e5946aed-8d23-4b14-b806-c62c21468d72 could not be found. Jul 31 14:24:09.322629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-ef1a6854-9435-4b8f-9966-246cc38f6b51 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Request method failure captured: Jul 31 14:24:09.322629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: request: GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72 HTTP/1.1 Jul 31 14:24:09.322629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept: application/json Jul 31 14:24:09.322629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept-Encoding: identity Jul 31 14:24:09.322629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Connection: close Jul 31 14:24:09.322629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Length: 0 Jul 31 14:24:09.322629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Type: application/json Jul 31 14:24:09.322629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Host: 10.222.0.40 Jul 31 14:24:09.322629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Openstack-System-Scope: None Jul 31 14:24:09.322629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: User-Agent: python-urllib3/1.26.10 Jul 31 14:24:09.322629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Auth-Token: gAAAAABi5pBt_aqMsMf9HaezdXslAYdYsG5PmbDe1CTM7G_hH6xUaEU-Pe2wMVvnd3hLTa3BuMBEdMdgZmmqPnV8OAYJc8jkIf6MCsSHgX_2R3nf4jN8WMKY-lixdxVxNYS1aDxMHI-6PCdZe0X17wfZPlgbu8Gg9F7YjO63zHUWHRZpvF3fQsU Jul 31 14:24:09.322629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Id: None Jul 31 14:24:09.322629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Name: None Jul 31 14:24:09.322629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Identity-Status: Confirmed Jul 31 14:24:09.322629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Is-Admin-Project: True Jul 31 14:24:09.322629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Id: default Jul 31 14:24:09.322629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Name: Default Jul 31 14:24:09.322629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Id: b8656d0df1af4475b502efe677f7308e Jul 31 14:24:09.322629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Name: tempest-VolumesActionsTest-881332668 Jul 31 14:24:09.322629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Role: reader,member Jul 31 14:24:09.322629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Roles: reader,member Jul 31 14:24:09.324546 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b8656d0df1af4475b502efe677f7308e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b8656d0df1af4475b502efe677f7308e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b8656d0df1af4475b502efe677f7308e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b8656d0df1af4475b502efe677f7308e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:24:09.324546 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant: tempest-VolumesActionsTest-881332668 Jul 31 14:24:09.324546 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Id: b8656d0df1af4475b502efe677f7308e Jul 31 14:24:09.324546 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Name: tempest-VolumesActionsTest-881332668 Jul 31 14:24:09.324546 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User: tempest-VolumesActionsTest-881332668-project Jul 31 14:24:09.324546 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Id: default Jul 31 14:24:09.324546 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Name: Default Jul 31 14:24:09.324546 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Id: d33866c1c77541a4bfd12d441e7ab175 Jul 31 14:24:09.324546 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Name: tempest-VolumesActionsTest-881332668-project Jul 31 14:24:09.324546 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: method: > Jul 31 14:24:09.324546 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: exception: Instance e5946aed-8d23-4b14-b806-c62c21468d72 could not be found. Jul 31 14:24:09.324546 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: action_args: {'id': 'e5946aed-8d23-4b14-b806-c62c21468d72'} Jul 31 14:24:09.326534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:24:09.326534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:09.326534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:24:09.326534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:24:09.326534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:24:09.326534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:24:09.326534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:24:09.326534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:24:09.326534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:24:09.326534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:24:09.326534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5946aed-8d23-4b14-b806-c62c21468d72 could not be found. Jul 31 14:24:09.326534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:24:09.326534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:09.326534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:24:09.326534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:09.326534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:24:09.326534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:24:09.326534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:24:09.326534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:24:09.326534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:24:09.327736 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:24:09.327736 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:24:09.327736 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:24:09.327736 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:24:09.327736 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:24:09.327736 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:24:09.327736 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:24:09.327736 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5946aed-8d23-4b14-b806-c62c21468d72 could not be found. Jul 31 14:24:09.327736 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:24:09.327736 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:09.327736 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:24:09.327736 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:09.327736 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:24:09.327736 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:24:09.327736 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:24:09.327736 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:24:09.327736 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5946aed-8d23-4b14-b806-c62c21468d72 could not be found. Jul 31 14:24:09.327736 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:24:09.328868 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-ef1a6854-9435-4b8f-9966-246cc38f6b51 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Returning 404 to user: Instance e5946aed-8d23-4b14-b806-c62c21468d72 could not be found. {{(pid=117781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:24:09.328868 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-ef1a6854-9435-4b8f-9966-246cc38f6b51 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72" status: 404 len: 111 microversion: 2.1 time: 0.031787 Jul 31 14:24:09.328868 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 95/206] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:09 2022] GET /compute/v2.1/servers/e5946aed-8d23-4b14-b806-c62c21468d72 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:24:09.427727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fd675ca5-cf7c-46d1-b5cb-88c6adfb459c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-459102043", "imageRef": "57bc051a-64d0-4317-aa93-a7a2aed39369", "flavorRef": "452", "networks": [{"uuid": "241a7056-b8af-4415-9520-9854cbe33cc1"}]}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:24:09.458054 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-5ef5ca90-3ddd-4f6d-8cab-3736bf757e15 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:09.458681 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-5ef5ca90-3ddd-4f6d-8cab-3736bf757e15 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:09.464737 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5ef5ca90-3ddd-4f6d-8cab-3736bf757e15 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:09.465192 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5ef5ca90-3ddd-4f6d-8cab-3736bf757e15 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:09.465955 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5ef5ca90-3ddd-4f6d-8cab-3736bf757e15 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:09.466394 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5ef5ca90-3ddd-4f6d-8cab-3736bf757e15 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:09.483372 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.network.neutron [None req-fd675ca5-cf7c-46d1-b5cb-88c6adfb459c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] validate_networks() for [('241a7056-b8af-4415-9520-9854cbe33cc1', None, None, None, None, None)] {{(pid=117780) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 14:24:09.606066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-5ef5ca90-3ddd-4f6d-8cab-3736bf757e15 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:09.616177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-5ef5ca90-3ddd-4f6d-8cab-3736bf757e15 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.161891 Jul 31 14:24:09.618542 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 96/207] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:09 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:24:09.853284 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-fd675ca5-cf7c-46d1-b5cb-88c6adfb459c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Flavor limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 14:24:09.853777 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-fd675ca5-cf7c-46d1-b5cb-88c6adfb459c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Image limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 14:24:09.854376 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-fd675ca5-cf7c-46d1-b5cb-88c6adfb459c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Flavor pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 14:24:09.854989 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-fd675ca5-cf7c-46d1-b5cb-88c6adfb459c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Image pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 14:24:09.855501 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-fd675ca5-cf7c-46d1-b5cb-88c6adfb459c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 14:24:09.864551 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd675ca5-cf7c-46d1-b5cb-88c6adfb459c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:09.865142 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd675ca5-cf7c-46d1-b5cb-88c6adfb459c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:09.865948 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd675ca5-cf7c-46d1-b5cb-88c6adfb459c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:09.866381 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd675ca5-cf7c-46d1-b5cb-88c6adfb459c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:09.886151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-fd675ca5-cf7c-46d1-b5cb-88c6adfb459c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Getting quotas for project b8656d0df1af4475b502efe677f7308e. Resources: {'cores', 'ram', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:24:09.890091 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-fd675ca5-cf7c-46d1-b5cb-88c6adfb459c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Getting quotas for user d33866c1c77541a4bfd12d441e7ab175 and project b8656d0df1af4475b502efe677f7308e. Resources: {'cores', 'ram', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:24:09.900963 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fd675ca5-cf7c-46d1-b5cb-88c6adfb459c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Going to run 1 instances... {{(pid=117780) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 14:24:09.903200 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fd675ca5-cf7c-46d1-b5cb-88c6adfb459c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57bc051a-64d0-4317-aa93-a7a2aed39369',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 14:24:09.951911 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fd675ca5-cf7c-46d1-b5cb-88c6adfb459c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528609 Jul 31 14:24:09.952480 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 112/208] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Jul 31 14:24:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 14:24:09.963918 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-72b3792c-31f1-4f08-aa62-5deb97372952 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:09.964531 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-72b3792c-31f1-4f08-aa62-5deb97372952 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:10.017949 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-72b3792c-31f1-4f08-aa62-5deb97372952 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:10.027152 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-72b3792c-31f1-4f08-aa62-5deb97372952 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6" status: 200 len: 1213 microversion: 2.1 time: 0.067270 Jul 31 14:24:10.040379 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 97/209] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:09 2022] GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:10.087523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1f3c86e8-cfc1-43d5-8f82-7cdd32c292e6 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Calling method '.version_select at 0x7f87e9b78ee0>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:10.187069 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1f3c86e8-cfc1-43d5-8f82-7cdd32c292e6 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/88892192-07d4-4cfc-9a7a-6c6f5a30b212" status: 200 len: 345 microversion: 2.1 time: 0.103456 Jul 31 14:24:10.187752 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 113/210] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Jul 31 14:24:10 2022] GET /compute/v2.1/os-volumes/88892192-07d4-4cfc-9a7a-6c6f5a30b212 => generated 345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:24:10.199934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-2e87704d-4894-4b82-9dee-962334d1d254 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Action: 'create', calling method: .version_select at 0x7f87eb87eee0>, body: {"snapshot": {"volume_id": "88892192-07d4-4cfc-9a7a-6c6f5a30b212", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-819779631"}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:24:10.381578 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-2e87704d-4894-4b82-9dee-962334d1d254 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] 10.222.0.40 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.184824 Jul 31 14:24:10.383792 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 98/211] 10.222.0.40 () {60 vars in 1162 bytes} [Sun Jul 31 14:24:10 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:24:10.396518 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-42e5c33c-485c-429a-9b92-5829fba7018a tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Calling method '.version_select at 0x7f87e9b88f70>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:10.431704 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-42e5c33c-485c-429a-9b92-5829fba7018a tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/0385c60e-7287-4f72-bbc6-a9a4ab61ce28" status: 200 len: 286 microversion: 2.1 time: 0.039879 Jul 31 14:24:10.432430 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 114/212] 10.222.0.40 () {58 vars in 1251 bytes} [Sun Jul 31 14:24:10 2022] GET /compute/v2.1/os-snapshots/0385c60e-7287-4f72-bbc6-a9a4ab61ce28 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:24:10.442599 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-d422d006-a908-497d-aca8-6e484af588af tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Calling method '.version_select at 0x7f87e9ba4e50>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:10.488492 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-d422d006-a908-497d-aca8-6e484af588af tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.049473 Jul 31 14:24:10.489154 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 99/213] 10.222.0.40 () {58 vars in 1140 bytes} [Sun Jul 31 14:24:10 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:24:10.500761 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e5e851ba-650e-4a8d-8e53-0f08c4d20ef2 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Calling method '.version_select at 0x7f87e9b78c10>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:10.532824 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e5e851ba-650e-4a8d-8e53-0f08c4d20ef2 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/0385c60e-7287-4f72-bbc6-a9a4ab61ce28" status: 200 len: 286 microversion: 2.1 time: 0.035804 Jul 31 14:24:10.533390 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 115/214] 10.222.0.40 () {58 vars in 1251 bytes} [Sun Jul 31 14:24:10 2022] GET /compute/v2.1/os-snapshots/0385c60e-7287-4f72-bbc6-a9a4ab61ce28 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:24:10.640441 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b12dd1da-d8d1-48cd-8b57-6213005ab1cd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:10.641128 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b12dd1da-d8d1-48cd-8b57-6213005ab1cd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:10.648659 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b12dd1da-d8d1-48cd-8b57-6213005ab1cd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:10.649268 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b12dd1da-d8d1-48cd-8b57-6213005ab1cd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:10.650044 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b12dd1da-d8d1-48cd-8b57-6213005ab1cd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:10.650482 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b12dd1da-d8d1-48cd-8b57-6213005ab1cd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:10.782670 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b12dd1da-d8d1-48cd-8b57-6213005ab1cd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:10.790663 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b12dd1da-d8d1-48cd-8b57-6213005ab1cd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.154488 Jul 31 14:24:10.791228 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 100/215] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:10 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:11.049435 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-847cecda-dc67-4096-894a-8b90e2b8eb95 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:11.050035 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-847cecda-dc67-4096-894a-8b90e2b8eb95 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:11.056119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-847cecda-dc67-4096-894a-8b90e2b8eb95 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:11.057311 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-847cecda-dc67-4096-894a-8b90e2b8eb95 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:11.057311 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-847cecda-dc67-4096-894a-8b90e2b8eb95 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:11.057726 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-847cecda-dc67-4096-894a-8b90e2b8eb95 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:11.117699 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-847cecda-dc67-4096-894a-8b90e2b8eb95 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:11.125041 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-847cecda-dc67-4096-894a-8b90e2b8eb95 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6" status: 200 len: 1265 microversion: 2.1 time: 0.079458 Jul 31 14:24:11.125603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 116/216] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:11 2022] GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6 => generated 1265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:11.544448 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-2cad9ccb-2b6e-4514-8f37-807392271bef tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Calling method '.version_select at 0x7f87e9ba4940>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:11.574135 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-2cad9ccb-2b6e-4514-8f37-807392271bef tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/0385c60e-7287-4f72-bbc6-a9a4ab61ce28" status: 200 len: 286 microversion: 2.1 time: 0.033438 Jul 31 14:24:11.574706 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 101/217] 10.222.0.40 () {58 vars in 1251 bytes} [Sun Jul 31 14:24:11 2022] GET /compute/v2.1/os-snapshots/0385c60e-7287-4f72-bbc6-a9a4ab61ce28 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:24:11.811856 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-682df3c7-1cc8-45b6-8078-19e5345ac05c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:11.812469 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-682df3c7-1cc8-45b6-8078-19e5345ac05c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:11.818845 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-682df3c7-1cc8-45b6-8078-19e5345ac05c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:11.819294 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-682df3c7-1cc8-45b6-8078-19e5345ac05c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:11.820667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-682df3c7-1cc8-45b6-8078-19e5345ac05c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:11.821109 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-682df3c7-1cc8-45b6-8078-19e5345ac05c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:11.961964 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-682df3c7-1cc8-45b6-8078-19e5345ac05c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:11.969959 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-682df3c7-1cc8-45b6-8078-19e5345ac05c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.161914 Jul 31 14:24:11.970540 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 117/218] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:11 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:12.146041 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-e4239e69-7655-4c14-9963-b4f91772a67d tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:12.147242 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-e4239e69-7655-4c14-9963-b4f91772a67d tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:12.153224 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e4239e69-7655-4c14-9963-b4f91772a67d tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:12.153827 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e4239e69-7655-4c14-9963-b4f91772a67d tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:12.154744 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e4239e69-7655-4c14-9963-b4f91772a67d tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:12.155504 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e4239e69-7655-4c14-9963-b4f91772a67d tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:12.218537 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e4239e69-7655-4c14-9963-b4f91772a67d tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:12.227213 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-e4239e69-7655-4c14-9963-b4f91772a67d tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6" status: 200 len: 1265 microversion: 2.1 time: 0.084731 Jul 31 14:24:12.238545 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 102/219] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:12 2022] GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:12.586254 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ebd7732c-710b-4d77-bc87-6db1aff95eb4 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Calling method '.version_select at 0x7f87e9b418b0>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:12.620636 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ebd7732c-710b-4d77-bc87-6db1aff95eb4 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/0385c60e-7287-4f72-bbc6-a9a4ab61ce28" status: 200 len: 286 microversion: 2.1 time: 0.037882 Jul 31 14:24:12.626169 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 118/220] 10.222.0.40 () {58 vars in 1251 bytes} [Sun Jul 31 14:24:12 2022] GET /compute/v2.1/os-snapshots/0385c60e-7287-4f72-bbc6-a9a4ab61ce28 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:24:12.991260 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b9842e12-1644-4d92-8f7f-4e27e2b2eac7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:12.991932 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b9842e12-1644-4d92-8f7f-4e27e2b2eac7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:12.999383 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b9842e12-1644-4d92-8f7f-4e27e2b2eac7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:13.000169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b9842e12-1644-4d92-8f7f-4e27e2b2eac7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:13.001408 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b9842e12-1644-4d92-8f7f-4e27e2b2eac7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:13.001852 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b9842e12-1644-4d92-8f7f-4e27e2b2eac7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:13.138771 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b9842e12-1644-4d92-8f7f-4e27e2b2eac7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:13.146832 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b9842e12-1644-4d92-8f7f-4e27e2b2eac7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.159391 Jul 31 14:24:13.147441 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 103/221] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:12 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:13.249552 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-71d344d4-8705-4f1d-a00c-16b929a5cc72 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:13.251268 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-71d344d4-8705-4f1d-a00c-16b929a5cc72 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:13.256132 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:24:13.265663 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-71d344d4-8705-4f1d-a00c-16b929a5cc72 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:13.266173 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-71d344d4-8705-4f1d-a00c-16b929a5cc72 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:13.267041 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-71d344d4-8705-4f1d-a00c-16b929a5cc72 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:13.267523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-71d344d4-8705-4f1d-a00c-16b929a5cc72 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:13.291365 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=100 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:24:13.340419 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-71d344d4-8705-4f1d-a00c-16b929a5cc72 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:13.349580 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-71d344d4-8705-4f1d-a00c-16b929a5cc72 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6" status: 200 len: 1265 microversion: 2.1 time: 0.105884 Jul 31 14:24:13.351301 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 119/222] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:13 2022] GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6 => generated 1265 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:13.634604 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-83cd1ea3-bba6-47a5-a552-d6d3f46d6258 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Calling method '.version_select at 0x7f87e9ba0430>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:13.669846 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-83cd1ea3-bba6-47a5-a552-d6d3f46d6258 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/0385c60e-7287-4f72-bbc6-a9a4ab61ce28" status: 200 len: 287 microversion: 2.1 time: 0.039617 Jul 31 14:24:13.671174 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 104/223] 10.222.0.40 () {58 vars in 1251 bytes} [Sun Jul 31 14:24:13 2022] GET /compute/v2.1/os-snapshots/0385c60e-7287-4f72-bbc6-a9a4ab61ce28 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:24:13.686787 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-73eb21ea-b504-4dd8-90ab-52fe349f0c74 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Calling method '.version_select at 0x7f87e9b41790>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:13.764768 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-73eb21ea-b504-4dd8-90ab-52fe349f0c74 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] 10.222.0.40 "DELETE /compute/v2.1/os-snapshots/0385c60e-7287-4f72-bbc6-a9a4ab61ce28" status: 202 len: 0 microversion: 2.1 time: 0.085768 Jul 31 14:24:13.765342 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 120/224] 10.222.0.40 () {58 vars in 1254 bytes} [Sun Jul 31 14:24:13 2022] DELETE /compute/v2.1/os-snapshots/0385c60e-7287-4f72-bbc6-a9a4ab61ce28 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:24:13.774070 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-619db7e4-fc83-4ac9-a3f1-682bb6dbd550 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Calling method '.version_select at 0x7f87e9ba00d0>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:13.813011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-619db7e4-fc83-4ac9-a3f1-682bb6dbd550 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/0385c60e-7287-4f72-bbc6-a9a4ab61ce28" status: 200 len: 286 microversion: 2.1 time: 0.042996 Jul 31 14:24:13.813507 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 105/225] 10.222.0.40 () {58 vars in 1251 bytes} [Sun Jul 31 14:24:13 2022] GET /compute/v2.1/os-snapshots/0385c60e-7287-4f72-bbc6-a9a4ab61ce28 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:24:14.168373 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-004d7658-7757-40aa-bfe0-f2b1c3f7b39d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:14.169254 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-004d7658-7757-40aa-bfe0-f2b1c3f7b39d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:14.176367 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-004d7658-7757-40aa-bfe0-f2b1c3f7b39d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:14.177471 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-004d7658-7757-40aa-bfe0-f2b1c3f7b39d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:14.178319 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-004d7658-7757-40aa-bfe0-f2b1c3f7b39d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:14.178956 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-004d7658-7757-40aa-bfe0-f2b1c3f7b39d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:14.326352 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-004d7658-7757-40aa-bfe0-f2b1c3f7b39d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:14.336656 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-004d7658-7757-40aa-bfe0-f2b1c3f7b39d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.172267 Jul 31 14:24:14.337237 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 121/226] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:14 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:14.373009 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-6223e150-858a-4117-8df2-14e34eed7f86 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:14.374188 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-6223e150-858a-4117-8df2-14e34eed7f86 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:14.380916 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6223e150-858a-4117-8df2-14e34eed7f86 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:14.381356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6223e150-858a-4117-8df2-14e34eed7f86 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:14.382946 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6223e150-858a-4117-8df2-14e34eed7f86 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:14.383377 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6223e150-858a-4117-8df2-14e34eed7f86 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:14.464730 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-6223e150-858a-4117-8df2-14e34eed7f86 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:14.468211 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:24:14.472954 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-6223e150-858a-4117-8df2-14e34eed7f86 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6" status: 200 len: 1271 microversion: 2.1 time: 0.104273 Jul 31 14:24:14.473518 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 106/227] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:14 2022] GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6 => generated 1271 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:14.826362 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ce6ef21b-d447-452d-8bb0-863ddb92241d tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Calling method '.version_select at 0x7f87e9b41dc0>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:14.855374 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-ce6ef21b-d447-452d-8bb0-863ddb92241d tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] HTTP exception thrown: Snapshot 0385c60e-7287-4f72-bbc6-a9a4ab61ce28 could not be found. Jul 31 14:24:14.857758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ce6ef21b-d447-452d-8bb0-863ddb92241d tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Request method failure captured: Jul 31 14:24:14.857758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/os-snapshots/0385c60e-7287-4f72-bbc6-a9a4ab61ce28 HTTP/1.1 Jul 31 14:24:14.857758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:24:14.857758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:24:14.857758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:24:14.857758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:24:14.857758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:24:14.857758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:24:14.857758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:24:14.857758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:24:14.857758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pCHYamssWrVMqx4vf180Y53XdIkhryH0SaCMPurjCVUjj8IPdKKSg3GRKHbDfakkkakr7D9CZRHIJAaYJCV1l4dSj0_SpyDsEpf6lw-11We0dXhw9qJJu84PzSWe13BaK4swbIGq6HsZQTi97fdMv6spMij2Fa1qSRnn8b8yvIs0tY Jul 31 14:24:14.857758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:24:14.857758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:24:14.857758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:24:14.857758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:24:14.857758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:24:14.857758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:24:14.857758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: 976675956dca4c50917939c4d660e0b1 Jul 31 14:24:14.857758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-790167725 Jul 31 14:24:14.857758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:24:14.857758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:24:14.859002 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/976675956dca4c50917939c4d660e0b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_976675956dca4c50917939c4d660e0b1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/976675956dca4c50917939c4d660e0b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/976675956dca4c50917939c4d660e0b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:24:14.859002 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-VolumesSnapshotsTestJSON-790167725 Jul 31 14:24:14.859002 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 976675956dca4c50917939c4d660e0b1 Jul 31 14:24:14.859002 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-790167725 Jul 31 14:24:14.859002 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-VolumesSnapshotsTestJSON-790167725-project Jul 31 14:24:14.859002 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:24:14.859002 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:24:14.859002 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: db1a21e1056443ae9317c997c25d69c6 Jul 31 14:24:14.859002 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-VolumesSnapshotsTestJSON-790167725-project Jul 31 14:24:14.859002 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: Jul 31 14:24:14.859002 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Snapshot 0385c60e-7287-4f72-bbc6-a9a4ab61ce28 could not be found. Jul 31 14:24:14.859002 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': '0385c60e-7287-4f72-bbc6-a9a4ab61ce28'} Jul 31 14:24:14.859002 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:24:14.859791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:14.859791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 31 14:24:14.859791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 31 14:24:14.859791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 31 14:24:14.859791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 31 14:24:14.859791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 31 14:24:14.859791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 31 14:24:14.859791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 14:24:14.859791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 14:24:14.859791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 14:24:14.859791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 14:24:14.859791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 14:24:14.859791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 14:24:14.859791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 14:24:14.859791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 14:24:14.859791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0385c60e-7287-4f72-bbc6-a9a4ab61ce28 could not be found. (HTTP 404) (Request-ID: req-21d277e4-f724-44d9-bca6-6d6e95f28e32) Jul 31 14:24:14.859791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:14.859791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:14.860737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:14.860737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:14.860737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 31 14:24:14.860737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 31 14:24:14.860737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 14:24:14.860737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 14:24:14.860737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 31 14:24:14.860737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 31 14:24:14.860737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 14:24:14.860737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 14:24:14.860737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 31 14:24:14.860737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 31 14:24:14.860737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 31 14:24:14.860737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 31 14:24:14.860737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 31 14:24:14.860737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 31 14:24:14.860737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 14:24:14.860737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 14:24:14.860737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 14:24:14.861819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 14:24:14.861819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 14:24:14.861819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 14:24:14.861819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 14:24:14.861819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 14:24:14.861819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0385c60e-7287-4f72-bbc6-a9a4ab61ce28 could not be found. Jul 31 14:24:14.861819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:14.861819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:14.861819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:14.861819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:14.861819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:24:14.861819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:24:14.861819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:24:14.861819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:24:14.861819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 14:24:14.861819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 14:24:14.861819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:24:14.861819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:24:14.861819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 31 14:24:14.861819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:24:14.862834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0385c60e-7287-4f72-bbc6-a9a4ab61ce28 could not be found. Jul 31 14:24:14.862834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:14.862834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:14.862834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:14.862834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:14.862834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:24:14.862834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:24:14.862834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:24:14.862834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:24:14.862834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0385c60e-7287-4f72-bbc6-a9a4ab61ce28 could not be found. Jul 31 14:24:14.862834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:14.862834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ce6ef21b-d447-452d-8bb0-863ddb92241d tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Returning 404 to user: Snapshot 0385c60e-7287-4f72-bbc6-a9a4ab61ce28 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:24:14.862834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ce6ef21b-d447-452d-8bb0-863ddb92241d tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] 10.222.0.40 "GET /compute/v2.1/os-snapshots/0385c60e-7287-4f72-bbc6-a9a4ab61ce28" status: 404 len: 111 microversion: 2.1 time: 0.037521 Jul 31 14:24:14.862834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 122/228] 10.222.0.40 () {58 vars in 1251 bytes} [Sun Jul 31 14:24:14 2022] GET /compute/v2.1/os-snapshots/0385c60e-7287-4f72-bbc6-a9a4ab61ce28 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:24:14.869570 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-87892d28-804c-4826-950e-314873948ab8 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Calling method '.version_select at 0x7f87e9ba05e0>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:14.952812 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-87892d28-804c-4826-950e-314873948ab8 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/88892192-07d4-4cfc-9a7a-6c6f5a30b212" status: 202 len: 0 microversion: 2.1 time: 0.087453 Jul 31 14:24:14.954095 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 107/229] 10.222.0.40 () {58 vars in 1248 bytes} [Sun Jul 31 14:24:14 2022] DELETE /compute/v2.1/os-volumes/88892192-07d4-4cfc-9a7a-6c6f5a30b212 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:24:14.962169 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3bc488e3-e5b4-425d-b141-e846d3dd23fa tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Calling method '.version_select at 0x7f87e9b34700>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:15.022746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3bc488e3-e5b4-425d-b141-e846d3dd23fa tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/88892192-07d4-4cfc-9a7a-6c6f5a30b212" status: 200 len: 344 microversion: 2.1 time: 0.064634 Jul 31 14:24:15.029232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 123/230] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Jul 31 14:24:14 2022] GET /compute/v2.1/os-volumes/88892192-07d4-4cfc-9a7a-6c6f5a30b212 => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:24:15.361023 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-e4a865a3-ea7f-47fc-97d9-317dbb166ebf tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:15.364349 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-e4a865a3-ea7f-47fc-97d9-317dbb166ebf tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:15.374164 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e4a865a3-ea7f-47fc-97d9-317dbb166ebf tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:15.381884 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e4a865a3-ea7f-47fc-97d9-317dbb166ebf tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:15.382979 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e4a865a3-ea7f-47fc-97d9-317dbb166ebf tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:15.383468 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e4a865a3-ea7f-47fc-97d9-317dbb166ebf tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:15.493736 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5c569f51-465d-4bd2-85a8-ae168f1e848c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:15.494372 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-5c569f51-465d-4bd2-85a8-ae168f1e848c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:15.502625 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5c569f51-465d-4bd2-85a8-ae168f1e848c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:15.503075 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5c569f51-465d-4bd2-85a8-ae168f1e848c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:15.503882 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5c569f51-465d-4bd2-85a8-ae168f1e848c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:15.504323 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5c569f51-465d-4bd2-85a8-ae168f1e848c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:15.684682 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-5c569f51-465d-4bd2-85a8-ae168f1e848c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:15.695228 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-5c569f51-465d-4bd2-85a8-ae168f1e848c tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6" status: 200 len: 1313 microversion: 2.1 time: 0.204781 Jul 31 14:24:15.696220 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 124/231] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:15 2022] GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:24:16.011439 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e4a865a3-ea7f-47fc-97d9-317dbb166ebf tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:16.024441 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-e4a865a3-ea7f-47fc-97d9-317dbb166ebf tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.667095 Jul 31 14:24:16.025517 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 108/232] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:15 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:16.047557 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1a8aa5cf-7ee4-4c16-bfa0-ad59b36fdf8f tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Calling method '.version_select at 0x7f87eb8b73a0>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:16.079851 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-1a8aa5cf-7ee4-4c16-bfa0-ad59b36fdf8f tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] HTTP exception thrown: Volume 88892192-07d4-4cfc-9a7a-6c6f5a30b212 could not be found. Jul 31 14:24:16.082139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1a8aa5cf-7ee4-4c16-bfa0-ad59b36fdf8f tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Request method failure captured: Jul 31 14:24:16.082139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/os-volumes/88892192-07d4-4cfc-9a7a-6c6f5a30b212 HTTP/1.1 Jul 31 14:24:16.082139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:24:16.082139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:24:16.082139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:24:16.082139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:24:16.082139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:24:16.082139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:24:16.082139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:24:16.082139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:24:16.082139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pCHYamssWrVMqx4vf180Y53XdIkhryH0SaCMPurjCVUjj8IPdKKSg3GRKHbDfakkkakr7D9CZRHIJAaYJCV1l4dSj0_SpyDsEpf6lw-11We0dXhw9qJJu84PzSWe13BaK4swbIGq6HsZQTi97fdMv6spMij2Fa1qSRnn8b8yvIs0tY Jul 31 14:24:16.082139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:24:16.082139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:24:16.082139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:24:16.082139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:24:16.082139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:24:16.082139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:24:16.082139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: 976675956dca4c50917939c4d660e0b1 Jul 31 14:24:16.082139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-790167725 Jul 31 14:24:16.082139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:24:16.082139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:24:16.083657 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/976675956dca4c50917939c4d660e0b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_976675956dca4c50917939c4d660e0b1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/976675956dca4c50917939c4d660e0b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/976675956dca4c50917939c4d660e0b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:24:16.083657 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-VolumesSnapshotsTestJSON-790167725 Jul 31 14:24:16.083657 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 976675956dca4c50917939c4d660e0b1 Jul 31 14:24:16.083657 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-790167725 Jul 31 14:24:16.083657 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-VolumesSnapshotsTestJSON-790167725-project Jul 31 14:24:16.083657 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:24:16.083657 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:24:16.083657 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: db1a21e1056443ae9317c997c25d69c6 Jul 31 14:24:16.083657 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-VolumesSnapshotsTestJSON-790167725-project Jul 31 14:24:16.083657 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: Jul 31 14:24:16.083657 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Volume 88892192-07d4-4cfc-9a7a-6c6f5a30b212 could not be found. Jul 31 14:24:16.083657 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': '88892192-07d4-4cfc-9a7a-6c6f5a30b212'} Jul 31 14:24:16.083657 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:24:16.084460 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:16.084460 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 14:24:16.084460 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 14:24:16.084460 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 14:24:16.084460 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 14:24:16.084460 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 14:24:16.084460 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 14:24:16.084460 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 14:24:16.084460 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 14:24:16.084460 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 14:24:16.084460 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 14:24:16.084460 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 14:24:16.084460 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 14:24:16.084460 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 14:24:16.084460 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 14:24:16.084460 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 88892192-07d4-4cfc-9a7a-6c6f5a30b212 could not be found. (HTTP 404) (Request-ID: req-8e68a874-b139-4153-bad1-aa6c51f15136) Jul 31 14:24:16.084460 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:16.084460 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:16.084460 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:16.085603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:16.085603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 31 14:24:16.085603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 31 14:24:16.085603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 14:24:16.085603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 14:24:16.085603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 14:24:16.085603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 14:24:16.085603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 14:24:16.085603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 14:24:16.085603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 14:24:16.085603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 14:24:16.085603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 14:24:16.085603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 14:24:16.085603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 14:24:16.085603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 14:24:16.085603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 14:24:16.085603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 14:24:16.085603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 14:24:16.085603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 14:24:16.086763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 14:24:16.086763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 14:24:16.086763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 14:24:16.086763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 14:24:16.086763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 88892192-07d4-4cfc-9a7a-6c6f5a30b212 could not be found. Jul 31 14:24:16.086763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:16.086763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:16.086763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:16.086763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:16.086763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:24:16.086763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:24:16.086763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:24:16.086763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:24:16.086763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 14:24:16.086763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 14:24:16.086763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:24:16.086763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:24:16.086763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 31 14:24:16.086763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:24:16.088038 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 88892192-07d4-4cfc-9a7a-6c6f5a30b212 could not be found. Jul 31 14:24:16.088038 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:16.088038 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:16.088038 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:16.088038 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:16.088038 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:24:16.088038 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:24:16.088038 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:24:16.088038 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:24:16.088038 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 88892192-07d4-4cfc-9a7a-6c6f5a30b212 could not be found. Jul 31 14:24:16.088038 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:16.090037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1a8aa5cf-7ee4-4c16-bfa0-ad59b36fdf8f tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Returning 404 to user: Volume 88892192-07d4-4cfc-9a7a-6c6f5a30b212 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:24:16.090909 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1a8aa5cf-7ee4-4c16-bfa0-ad59b36fdf8f tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/88892192-07d4-4cfc-9a7a-6c6f5a30b212" status: 404 len: 109 microversion: 2.1 time: 0.048537 Jul 31 14:24:16.091687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 125/233] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Jul 31 14:24:16 2022] GET /compute/v2.1/os-volumes/88892192-07d4-4cfc-9a7a-6c6f5a30b212 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:24:16.106098 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-348bbb76-096a-4f9d-8845-748ffd3f8090 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Calling method '.version_select at 0x7f87e9ba0af0>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:16.137201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.wsgi [None req-348bbb76-096a-4f9d-8845-748ffd3f8090 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] HTTP exception thrown: Volume 88892192-07d4-4cfc-9a7a-6c6f5a30b212 could not be found. Jul 31 14:24:16.140435 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-348bbb76-096a-4f9d-8845-748ffd3f8090 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Request method failure captured: Jul 31 14:24:16.140435 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: request: DELETE /compute/v2.1/os-volumes/88892192-07d4-4cfc-9a7a-6c6f5a30b212 HTTP/1.1 Jul 31 14:24:16.140435 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept: application/json Jul 31 14:24:16.140435 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept-Encoding: identity Jul 31 14:24:16.140435 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Connection: close Jul 31 14:24:16.140435 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Length: 0 Jul 31 14:24:16.140435 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Type: application/json Jul 31 14:24:16.140435 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Host: 10.222.0.40 Jul 31 14:24:16.140435 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Openstack-System-Scope: None Jul 31 14:24:16.140435 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: User-Agent: python-urllib3/1.26.10 Jul 31 14:24:16.140435 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Auth-Token: gAAAAABi5pCHYamssWrVMqx4vf180Y53XdIkhryH0SaCMPurjCVUjj8IPdKKSg3GRKHbDfakkkakr7D9CZRHIJAaYJCV1l4dSj0_SpyDsEpf6lw-11We0dXhw9qJJu84PzSWe13BaK4swbIGq6HsZQTi97fdMv6spMij2Fa1qSRnn8b8yvIs0tY Jul 31 14:24:16.140435 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Id: None Jul 31 14:24:16.140435 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Name: None Jul 31 14:24:16.140435 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Identity-Status: Confirmed Jul 31 14:24:16.140435 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Is-Admin-Project: True Jul 31 14:24:16.140435 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Id: default Jul 31 14:24:16.140435 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Name: Default Jul 31 14:24:16.140435 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Id: 976675956dca4c50917939c4d660e0b1 Jul 31 14:24:16.140435 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-790167725 Jul 31 14:24:16.140435 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Role: reader,member Jul 31 14:24:16.140435 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Roles: reader,member Jul 31 14:24:16.141617 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/976675956dca4c50917939c4d660e0b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_976675956dca4c50917939c4d660e0b1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/976675956dca4c50917939c4d660e0b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/976675956dca4c50917939c4d660e0b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:24:16.141617 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant: tempest-VolumesSnapshotsTestJSON-790167725 Jul 31 14:24:16.141617 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Id: 976675956dca4c50917939c4d660e0b1 Jul 31 14:24:16.141617 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-790167725 Jul 31 14:24:16.141617 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User: tempest-VolumesSnapshotsTestJSON-790167725-project Jul 31 14:24:16.141617 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Id: default Jul 31 14:24:16.141617 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Name: Default Jul 31 14:24:16.141617 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Id: db1a21e1056443ae9317c997c25d69c6 Jul 31 14:24:16.141617 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Name: tempest-VolumesSnapshotsTestJSON-790167725-project Jul 31 14:24:16.141617 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: method: Jul 31 14:24:16.141617 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: exception: Volume 88892192-07d4-4cfc-9a7a-6c6f5a30b212 could not be found. Jul 31 14:24:16.141617 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: action_args: {'id': '88892192-07d4-4cfc-9a7a-6c6f5a30b212'} Jul 31 14:24:16.141617 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:24:16.142309 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:16.142309 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 14:24:16.142309 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 14:24:16.142309 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 14:24:16.142309 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 14:24:16.142309 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 14:24:16.142309 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 14:24:16.142309 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 14:24:16.142309 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 14:24:16.142309 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 14:24:16.142309 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 14:24:16.142309 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 14:24:16.142309 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 14:24:16.142309 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 14:24:16.142309 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 14:24:16.142309 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 88892192-07d4-4cfc-9a7a-6c6f5a30b212 could not be found. (HTTP 404) (Request-ID: req-816f63c5-79f4-481b-99d0-2d3d0bae90dc) Jul 31 14:24:16.142309 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:24:16.142309 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:16.142309 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:24:16.143356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:16.143356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 31 14:24:16.143356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 31 14:24:16.143356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 14:24:16.143356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 14:24:16.143356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 14:24:16.143356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 14:24:16.143356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 14:24:16.143356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 14:24:16.143356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 14:24:16.143356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 14:24:16.143356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 31 14:24:16.143356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 31 14:24:16.143356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 31 14:24:16.143356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 31 14:24:16.143356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 31 14:24:16.143356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 31 14:24:16.143356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 31 14:24:16.143356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 31 14:24:16.144582 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 14:24:16.144582 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 14:24:16.144582 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 14:24:16.144582 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 14:24:16.144582 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 88892192-07d4-4cfc-9a7a-6c6f5a30b212 could not be found. Jul 31 14:24:16.144582 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:24:16.144582 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:16.144582 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:24:16.144582 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:16.144582 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:24:16.144582 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:24:16.144582 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:24:16.144582 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:24:16.144582 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 14:24:16.144582 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 14:24:16.144582 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:24:16.144582 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:24:16.144582 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 31 14:24:16.144582 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:24:16.146754 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 88892192-07d4-4cfc-9a7a-6c6f5a30b212 could not be found. Jul 31 14:24:16.146754 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:24:16.146754 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:16.146754 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:24:16.146754 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:16.146754 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:24:16.146754 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:24:16.146754 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:24:16.146754 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:24:16.146754 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 88892192-07d4-4cfc-9a7a-6c6f5a30b212 could not be found. Jul 31 14:24:16.146754 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:24:16.146754 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-348bbb76-096a-4f9d-8845-748ffd3f8090 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Returning 404 to user: Volume 88892192-07d4-4cfc-9a7a-6c6f5a30b212 could not be found. {{(pid=117781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:24:16.146754 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-348bbb76-096a-4f9d-8845-748ffd3f8090 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] 10.222.0.40 "DELETE /compute/v2.1/os-volumes/88892192-07d4-4cfc-9a7a-6c6f5a30b212" status: 404 len: 109 microversion: 2.1 time: 0.039819 Jul 31 14:24:16.146754 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 109/234] 10.222.0.40 () {58 vars in 1248 bytes} [Sun Jul 31 14:24:16 2022] DELETE /compute/v2.1/os-volumes/88892192-07d4-4cfc-9a7a-6c6f5a30b212 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:24:16.152591 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-87af0158-c844-4abb-814d-84d6953d3573 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Calling method '.version_select at 0x7f87e9b413a0>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:16.184689 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-87af0158-c844-4abb-814d-84d6953d3573 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] HTTP exception thrown: Volume 88892192-07d4-4cfc-9a7a-6c6f5a30b212 could not be found. Jul 31 14:24:16.186739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-87af0158-c844-4abb-814d-84d6953d3573 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Request method failure captured: Jul 31 14:24:16.186739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/os-volumes/88892192-07d4-4cfc-9a7a-6c6f5a30b212 HTTP/1.1 Jul 31 14:24:16.186739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:24:16.186739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:24:16.186739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:24:16.186739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:24:16.186739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:24:16.186739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:24:16.186739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:24:16.186739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:24:16.186739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pCHYamssWrVMqx4vf180Y53XdIkhryH0SaCMPurjCVUjj8IPdKKSg3GRKHbDfakkkakr7D9CZRHIJAaYJCV1l4dSj0_SpyDsEpf6lw-11We0dXhw9qJJu84PzSWe13BaK4swbIGq6HsZQTi97fdMv6spMij2Fa1qSRnn8b8yvIs0tY Jul 31 14:24:16.186739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:24:16.186739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:24:16.186739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:24:16.186739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:24:16.186739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:24:16.186739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:24:16.186739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: 976675956dca4c50917939c4d660e0b1 Jul 31 14:24:16.186739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-790167725 Jul 31 14:24:16.186739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:24:16.186739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:24:16.187920 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/976675956dca4c50917939c4d660e0b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_976675956dca4c50917939c4d660e0b1", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/976675956dca4c50917939c4d660e0b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/976675956dca4c50917939c4d660e0b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:24:16.187920 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-VolumesSnapshotsTestJSON-790167725 Jul 31 14:24:16.187920 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 976675956dca4c50917939c4d660e0b1 Jul 31 14:24:16.187920 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-790167725 Jul 31 14:24:16.187920 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-VolumesSnapshotsTestJSON-790167725-project Jul 31 14:24:16.187920 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:24:16.187920 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:24:16.187920 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: db1a21e1056443ae9317c997c25d69c6 Jul 31 14:24:16.187920 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-VolumesSnapshotsTestJSON-790167725-project Jul 31 14:24:16.187920 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: Jul 31 14:24:16.187920 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Volume 88892192-07d4-4cfc-9a7a-6c6f5a30b212 could not be found. Jul 31 14:24:16.187920 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': '88892192-07d4-4cfc-9a7a-6c6f5a30b212'} Jul 31 14:24:16.187920 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:24:16.188598 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:16.188598 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 14:24:16.188598 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 14:24:16.188598 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 14:24:16.188598 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 14:24:16.188598 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 14:24:16.188598 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 14:24:16.188598 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 14:24:16.188598 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 14:24:16.188598 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 14:24:16.188598 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 14:24:16.188598 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 14:24:16.188598 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 14:24:16.188598 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 14:24:16.188598 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 14:24:16.188598 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 88892192-07d4-4cfc-9a7a-6c6f5a30b212 could not be found. (HTTP 404) (Request-ID: req-0d597b04-e5c2-46da-b42f-34c41fbcb230) Jul 31 14:24:16.188598 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:16.188598 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:16.188598 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:16.189741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:16.189741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 31 14:24:16.189741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 31 14:24:16.189741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 31 14:24:16.189741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 31 14:24:16.189741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 31 14:24:16.189741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 31 14:24:16.189741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 31 14:24:16.189741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 31 14:24:16.189741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 31 14:24:16.189741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 31 14:24:16.189741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 31 14:24:16.189741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 31 14:24:16.189741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 31 14:24:16.189741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 31 14:24:16.189741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 31 14:24:16.189741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 31 14:24:16.189741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 31 14:24:16.189741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 31 14:24:16.190733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 31 14:24:16.190733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 31 14:24:16.190733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 31 14:24:16.190733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 31 14:24:16.190733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 88892192-07d4-4cfc-9a7a-6c6f5a30b212 could not be found. Jul 31 14:24:16.190733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:16.190733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:16.190733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:16.190733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:16.190733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:24:16.190733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:24:16.190733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:24:16.190733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:24:16.190733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 31 14:24:16.190733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 31 14:24:16.190733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:24:16.190733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:24:16.190733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 31 14:24:16.190733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:24:16.191752 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 88892192-07d4-4cfc-9a7a-6c6f5a30b212 could not be found. Jul 31 14:24:16.191752 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:16.191752 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:16.191752 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:16.191752 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:16.191752 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:24:16.191752 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:24:16.191752 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:24:16.191752 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:24:16.191752 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 88892192-07d4-4cfc-9a7a-6c6f5a30b212 could not be found. Jul 31 14:24:16.191752 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:16.196883 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-87af0158-c844-4abb-814d-84d6953d3573 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] Returning 404 to user: Volume 88892192-07d4-4cfc-9a7a-6c6f5a30b212 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:24:16.196883 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-87af0158-c844-4abb-814d-84d6953d3573 tempest-VolumesSnapshotsTestJSON-790167725 tempest-VolumesSnapshotsTestJSON-790167725-project] 10.222.0.40 "GET /compute/v2.1/os-volumes/88892192-07d4-4cfc-9a7a-6c6f5a30b212" status: 404 len: 109 microversion: 2.1 time: 0.047553 Jul 31 14:24:16.196883 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 126/235] 10.222.0.40 () {58 vars in 1245 bytes} [Sun Jul 31 14:24:16 2022] GET /compute/v2.1/os-volumes/88892192-07d4-4cfc-9a7a-6c6f5a30b212 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 14:24:16.722919 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7e4b3382-c651-4bc1-b973-65510ebddf95 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:16.724436 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7e4b3382-c651-4bc1-b973-65510ebddf95 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:16.741056 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7e4b3382-c651-4bc1-b973-65510ebddf95 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:16.742032 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7e4b3382-c651-4bc1-b973-65510ebddf95 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:16.743280 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7e4b3382-c651-4bc1-b973-65510ebddf95 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:16.744056 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7e4b3382-c651-4bc1-b973-65510ebddf95 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:17.049463 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-43ebd6f0-43e6-40c8-bdc9-9a18d92e69e7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:17.050081 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-43ebd6f0-43e6-40c8-bdc9-9a18d92e69e7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:17.065365 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-43ebd6f0-43e6-40c8-bdc9-9a18d92e69e7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:17.065922 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-43ebd6f0-43e6-40c8-bdc9-9a18d92e69e7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:17.066743 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-43ebd6f0-43e6-40c8-bdc9-9a18d92e69e7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:17.067184 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-43ebd6f0-43e6-40c8-bdc9-9a18d92e69e7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:17.072153 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7e4b3382-c651-4bc1-b973-65510ebddf95 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:17.087369 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7e4b3382-c651-4bc1-b973-65510ebddf95 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6" status: 200 len: 1313 microversion: 2.1 time: 0.368728 Jul 31 14:24:17.088340 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 110/236] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:16 2022] GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6 => generated 1313 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:17.175401 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-8d276c15-d41b-4348-abeb-ef64aee16384 req-0c86b79f-e201-4161-a6fb-c2b0aa12f8e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f26e8fa-7258-4095-9b2f-22864303f9a6", "tag": "03e23c1b-3995-4bf1-8f91-a0cab5a727db"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:24:17.200648 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-8d276c15-d41b-4348-abeb-ef64aee16384 req-0c86b79f-e201-4161-a6fb-c2b0aa12f8e9 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:17.201138 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-8d276c15-d41b-4348-abeb-ef64aee16384 req-0c86b79f-e201-4161-a6fb-c2b0aa12f8e9 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:17.223917 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-8d276c15-d41b-4348-abeb-ef64aee16384 req-0c86b79f-e201-4161-a6fb-c2b0aa12f8e9 service nova] Creating event network-changed:03e23c1b-3995-4bf1-8f91-a0cab5a727db for instance 5f26e8fa-7258-4095-9b2f-22864303f9a6 on hv-cinder-84984 Jul 31 14:24:17.234974 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-8d276c15-d41b-4348-abeb-ef64aee16384 req-0c86b79f-e201-4161-a6fb-c2b0aa12f8e9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064829 Jul 31 14:24:17.235974 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 111/237] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:24:17.317035 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-43ebd6f0-43e6-40c8-bdc9-9a18d92e69e7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:17.328824 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-43ebd6f0-43e6-40c8-bdc9-9a18d92e69e7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1521 microversion: 2.1 time: 0.284212 Jul 31 14:24:17.333407 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 127/238] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:17 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:18.113938 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-a46b0fb7-a8fa-4886-88de-27e185e4308a tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:18.116354 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-a46b0fb7-a8fa-4886-88de-27e185e4308a tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:18.135356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a46b0fb7-a8fa-4886-88de-27e185e4308a tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:18.136595 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a46b0fb7-a8fa-4886-88de-27e185e4308a tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:18.136595 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a46b0fb7-a8fa-4886-88de-27e185e4308a tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:18.137034 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a46b0fb7-a8fa-4886-88de-27e185e4308a tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:18.354904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1e3cdf58-19cf-4749-8afd-469e06f3f38c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:18.356178 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1e3cdf58-19cf-4749-8afd-469e06f3f38c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:18.373454 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1e3cdf58-19cf-4749-8afd-469e06f3f38c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:18.375080 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1e3cdf58-19cf-4749-8afd-469e06f3f38c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:18.376372 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1e3cdf58-19cf-4749-8afd-469e06f3f38c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:18.377071 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1e3cdf58-19cf-4749-8afd-469e06f3f38c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:18.650119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1e3cdf58-19cf-4749-8afd-469e06f3f38c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:18.665208 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1e3cdf58-19cf-4749-8afd-469e06f3f38c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1501 microversion: 2.1 time: 0.315300 Jul 31 14:24:18.667733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 128/239] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:18 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1501 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:18.702737 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a46b0fb7-a8fa-4886-88de-27e185e4308a tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:18.729905 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1b618f4d-9112-406d-9b1b-6625f1d55d2b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:18.730760 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1b618f4d-9112-406d-9b1b-6625f1d55d2b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:18.736275 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-a46b0fb7-a8fa-4886-88de-27e185e4308a tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6" status: 200 len: 1313 microversion: 2.1 time: 0.623017 Jul 31 14:24:18.744767 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1b618f4d-9112-406d-9b1b-6625f1d55d2b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:18.745215 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1b618f4d-9112-406d-9b1b-6625f1d55d2b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:18.745993 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1b618f4d-9112-406d-9b1b-6625f1d55d2b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:18.746423 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1b618f4d-9112-406d-9b1b-6625f1d55d2b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:18.748719 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 112/240] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:18 2022] GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6 => generated 1313 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:18.941752 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1b618f4d-9112-406d-9b1b-6625f1d55d2b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:18.955584 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1b618f4d-9112-406d-9b1b-6625f1d55d2b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1515 microversion: 2.1 time: 0.266898 Jul 31 14:24:18.956625 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 129/241] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:18 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1515 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:19.763201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-63d8f05b-46e4-46fe-a075-27ab40fcedb4 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:19.764033 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-63d8f05b-46e4-46fe-a075-27ab40fcedb4 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:19.778766 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-63d8f05b-46e4-46fe-a075-27ab40fcedb4 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:19.780573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-63d8f05b-46e4-46fe-a075-27ab40fcedb4 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:19.781434 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-63d8f05b-46e4-46fe-a075-27ab40fcedb4 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:19.783384 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-63d8f05b-46e4-46fe-a075-27ab40fcedb4 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:20.024438 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:24:20.030369 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-63d8f05b-46e4-46fe-a075-27ab40fcedb4 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:20.054405 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-63d8f05b-46e4-46fe-a075-27ab40fcedb4 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6" status: 200 len: 1313 microversion: 2.1 time: 0.297531 Jul 31 14:24:20.057340 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 113/242] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:19 2022] GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6 => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:20.526419 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a8952bf6-cad8-448e-973f-455689352e19 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:24:20.533808 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a8952bf6-cad8-448e-973f-455689352e19 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:20.536451 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:24:20.537150 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=6 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:24:20.550016 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a8952bf6-cad8-448e-973f-455689352e19 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:20.551544 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a8952bf6-cad8-448e-973f-455689352e19 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:20.553227 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a8952bf6-cad8-448e-973f-455689352e19 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:20.554469 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a8952bf6-cad8-448e-973f-455689352e19 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:20.590889 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-a8952bf6-cad8-448e-973f-455689352e19 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lazy-loading 'flavor' on Instance uuid 712880e4-54c2-4ea2-b932-a8ff5efa0966 {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:24:20.789352 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a8952bf6-cad8-448e-973f-455689352e19 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "POST /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966/action" status: 200 len: 32 microversion: 2.1 time: 0.267575 Jul 31 14:24:20.790788 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 130/243] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Jul 31 14:24:20 2022] POST /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966/action => generated 32 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 14:24:20.804455 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-e17f7b2d-08cb-4e9c-80c9-f2f944b26e9d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:20.805599 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-e17f7b2d-08cb-4e9c-80c9-f2f944b26e9d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:20.812290 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e17f7b2d-08cb-4e9c-80c9-f2f944b26e9d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:20.812734 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e17f7b2d-08cb-4e9c-80c9-f2f944b26e9d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:20.813680 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e17f7b2d-08cb-4e9c-80c9-f2f944b26e9d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:20.814352 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e17f7b2d-08cb-4e9c-80c9-f2f944b26e9d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:21.029978 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e17f7b2d-08cb-4e9c-80c9-f2f944b26e9d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:21.038437 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-e17f7b2d-08cb-4e9c-80c9-f2f944b26e9d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.241726 Jul 31 14:24:21.039630 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 114/244] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:20 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:21.077063 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-125c3434-a5d2-4e7b-84e0-f390560847ec tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:21.077781 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-125c3434-a5d2-4e7b-84e0-f390560847ec tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:21.091302 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-125c3434-a5d2-4e7b-84e0-f390560847ec tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:21.091845 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-125c3434-a5d2-4e7b-84e0-f390560847ec tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:21.092677 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-125c3434-a5d2-4e7b-84e0-f390560847ec tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:21.093121 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-125c3434-a5d2-4e7b-84e0-f390560847ec tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:21.371574 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-125c3434-a5d2-4e7b-84e0-f390560847ec tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:21.382996 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-125c3434-a5d2-4e7b-84e0-f390560847ec tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6" status: 200 len: 1313 microversion: 2.1 time: 0.310901 Jul 31 14:24:21.392513 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 131/245] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:21 2022] GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6 => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:22.063770 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-bdabb182-03b5-4926-8a1e-ece23825929e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:22.065257 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-bdabb182-03b5-4926-8a1e-ece23825929e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:22.071753 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bdabb182-03b5-4926-8a1e-ece23825929e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:22.072458 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bdabb182-03b5-4926-8a1e-ece23825929e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:22.073342 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bdabb182-03b5-4926-8a1e-ece23825929e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:22.073888 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bdabb182-03b5-4926-8a1e-ece23825929e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:22.276439 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-bdabb182-03b5-4926-8a1e-ece23825929e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:22.285441 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-bdabb182-03b5-4926-8a1e-ece23825929e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.227887 Jul 31 14:24:22.287371 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 115/246] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:22 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:22.406109 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-957deca5-b9ed-4c59-8c71-aec8ac9032af tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:22.406695 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-957deca5-b9ed-4c59-8c71-aec8ac9032af tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:22.418567 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-957deca5-b9ed-4c59-8c71-aec8ac9032af tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:22.419272 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-957deca5-b9ed-4c59-8c71-aec8ac9032af tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:22.420249 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-957deca5-b9ed-4c59-8c71-aec8ac9032af tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:22.420830 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-957deca5-b9ed-4c59-8c71-aec8ac9032af tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:22.714849 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-957deca5-b9ed-4c59-8c71-aec8ac9032af tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:22.723727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-957deca5-b9ed-4c59-8c71-aec8ac9032af tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6" status: 200 len: 1313 microversion: 2.1 time: 0.321414 Jul 31 14:24:22.725543 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 132/247] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:22 2022] GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6 => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:23.311870 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-addb4bd7-9ccc-4e3e-af51-eed3b66d80e5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:23.312489 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-addb4bd7-9ccc-4e3e-af51-eed3b66d80e5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:23.320098 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-addb4bd7-9ccc-4e3e-af51-eed3b66d80e5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:23.320740 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-addb4bd7-9ccc-4e3e-af51-eed3b66d80e5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:23.321708 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-addb4bd7-9ccc-4e3e-af51-eed3b66d80e5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:23.322141 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-addb4bd7-9ccc-4e3e-af51-eed3b66d80e5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:23.490771 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-addb4bd7-9ccc-4e3e-af51-eed3b66d80e5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:23.499651 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-addb4bd7-9ccc-4e3e-af51-eed3b66d80e5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.193298 Jul 31 14:24:23.500909 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 116/248] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:23 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:23.744515 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-93d081de-b3d9-462f-a53f-e696ef0dbb1f tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:23.745113 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-93d081de-b3d9-462f-a53f-e696ef0dbb1f tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:23.751579 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-93d081de-b3d9-462f-a53f-e696ef0dbb1f tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:23.752028 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-93d081de-b3d9-462f-a53f-e696ef0dbb1f tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:23.752925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-93d081de-b3d9-462f-a53f-e696ef0dbb1f tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:23.753204 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-93d081de-b3d9-462f-a53f-e696ef0dbb1f tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:24.026290 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-93d081de-b3d9-462f-a53f-e696ef0dbb1f tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:24.040929 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-93d081de-b3d9-462f-a53f-e696ef0dbb1f tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6" status: 200 len: 1313 microversion: 2.1 time: 0.300144 Jul 31 14:24:24.059481 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 133/249] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:23 2022] GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6 => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:24.521418 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-a489215d-277b-4623-b3db-20fcd9150e81 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:24.522008 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-a489215d-277b-4623-b3db-20fcd9150e81 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:24.524012 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:24:24.529325 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a489215d-277b-4623-b3db-20fcd9150e81 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:24.529971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a489215d-277b-4623-b3db-20fcd9150e81 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:24.530826 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a489215d-277b-4623-b3db-20fcd9150e81 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:24.531528 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a489215d-277b-4623-b3db-20fcd9150e81 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:24.753504 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a489215d-277b-4623-b3db-20fcd9150e81 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:24.761234 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-a489215d-277b-4623-b3db-20fcd9150e81 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.243937 Jul 31 14:24:24.761810 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 117/250] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:24 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:25.069056 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5b3d5e90-3943-473b-a3fc-85081aba0248 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:25.070940 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-5b3d5e90-3943-473b-a3fc-85081aba0248 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:25.096709 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5b3d5e90-3943-473b-a3fc-85081aba0248 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:25.104976 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5b3d5e90-3943-473b-a3fc-85081aba0248 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:25.106538 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5b3d5e90-3943-473b-a3fc-85081aba0248 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:25.110248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5b3d5e90-3943-473b-a3fc-85081aba0248 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:25.300548 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-5b3d5e90-3943-473b-a3fc-85081aba0248 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:25.311272 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-5b3d5e90-3943-473b-a3fc-85081aba0248 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6" status: 200 len: 1313 microversion: 2.1 time: 0.246511 Jul 31 14:24:25.326636 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 134/251] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:25 2022] GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6 => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:25.783262 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b81ad017-5c4b-4316-9af5-092607b5e767 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:25.784089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b81ad017-5c4b-4316-9af5-092607b5e767 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:25.797018 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b81ad017-5c4b-4316-9af5-092607b5e767 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:25.797644 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b81ad017-5c4b-4316-9af5-092607b5e767 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:25.798571 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b81ad017-5c4b-4316-9af5-092607b5e767 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:25.799157 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b81ad017-5c4b-4316-9af5-092607b5e767 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:26.147104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b81ad017-5c4b-4316-9af5-092607b5e767 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:26.160130 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b81ad017-5c4b-4316-9af5-092607b5e767 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.380535 Jul 31 14:24:26.164907 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 118/252] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:25 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:26.332399 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1694d265-09ae-4699-8369-efd088d428fb tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:26.333657 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1694d265-09ae-4699-8369-efd088d428fb tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:26.344066 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1694d265-09ae-4699-8369-efd088d428fb tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:26.344829 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1694d265-09ae-4699-8369-efd088d428fb tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:26.346549 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1694d265-09ae-4699-8369-efd088d428fb tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:26.348224 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1694d265-09ae-4699-8369-efd088d428fb tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:26.752573 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1694d265-09ae-4699-8369-efd088d428fb tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:26.771766 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1694d265-09ae-4699-8369-efd088d428fb tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6" status: 200 len: 1313 microversion: 2.1 time: 0.443105 Jul 31 14:24:26.774959 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 135/253] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:26 2022] GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6 => generated 1313 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:27.045758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-068353a0-7eb7-4c72-835e-7ebb94f6ef48 req-fc963f83-bd87-4fc5-a559-227cab18fb96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f26e8fa-7258-4095-9b2f-22864303f9a6", "name": "network-vif-plugged", "status": "completed", "tag": "03e23c1b-3995-4bf1-8f91-a0cab5a727db"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:24:27.058261 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-068353a0-7eb7-4c72-835e-7ebb94f6ef48 req-fc963f83-bd87-4fc5-a559-227cab18fb96 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:27.060123 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-068353a0-7eb7-4c72-835e-7ebb94f6ef48 req-fc963f83-bd87-4fc5-a559-227cab18fb96 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:27.072651 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-068353a0-7eb7-4c72-835e-7ebb94f6ef48 req-fc963f83-bd87-4fc5-a559-227cab18fb96 service nova] Creating event network-vif-plugged:03e23c1b-3995-4bf1-8f91-a0cab5a727db for instance 5f26e8fa-7258-4095-9b2f-22864303f9a6 on hv-cinder-84984 Jul 31 14:24:27.081074 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-068353a0-7eb7-4c72-835e-7ebb94f6ef48 req-fc963f83-bd87-4fc5-a559-227cab18fb96 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038646 Jul 31 14:24:27.081208 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-a21a687c-a460-48cb-b64d-32f4ad886f4d tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Action: 'create', calling method: .version_select at 0x7f87e9bad550>, body: {"keypair": {"name": "tempest-TestShelveInstance-56261385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJ1Irz2Vc0yGQ/T24TkyggYiWtwnZZqX9ZRTXUZSZPKczPxOdUpQ0/GilU0iQGlHpB2dspdBXF2ecrgN8V5367lTlGo1KVY8Q+ejIzWpRDe566l+PiwvWt6a8DtjnDqFg=="}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:24:27.087923 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 136/254] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:24:27.095933 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-a21a687c-a460-48cb-b64d-32f4ad886f4d tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Getting quotas for project d9ff0edf56fa403e8b9bf25fe004cdd3. Resources: {'key_pairs'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:24:27.099734 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-a21a687c-a460-48cb-b64d-32f4ad886f4d tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Getting quotas for user 26ca8614358245b99f621edc7f1d0021 and project d9ff0edf56fa403e8b9bf25fe004cdd3. Resources: {'key_pairs'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:24:27.123696 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-a21a687c-a460-48cb-b64d-32f4ad886f4d tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.256800 Jul 31 14:24:27.127627 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 119/255] 10.222.0.40 () {60 vars in 1159 bytes} [Sun Jul 31 14:24:26 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:24:27.188380 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ed10c250-e9e9-4097-be06-2136a33301c4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:27.189075 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ed10c250-e9e9-4097-be06-2136a33301c4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:27.197081 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ed10c250-e9e9-4097-be06-2136a33301c4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:27.197529 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ed10c250-e9e9-4097-be06-2136a33301c4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:27.198441 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ed10c250-e9e9-4097-be06-2136a33301c4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:27.198919 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ed10c250-e9e9-4097-be06-2136a33301c4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:27.430378 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ed10c250-e9e9-4097-be06-2136a33301c4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:27.441669 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ed10c250-e9e9-4097-be06-2136a33301c4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.259698 Jul 31 14:24:27.442490 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 137/256] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:27 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:27.796040 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-fe4da59d-7e95-43c5-a46b-3c577ce924a7 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:27.796652 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-fe4da59d-7e95-43c5-a46b-3c577ce924a7 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:27.804220 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fe4da59d-7e95-43c5-a46b-3c577ce924a7 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:27.804678 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fe4da59d-7e95-43c5-a46b-3c577ce924a7 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:27.805456 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fe4da59d-7e95-43c5-a46b-3c577ce924a7 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:27.806071 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fe4da59d-7e95-43c5-a46b-3c577ce924a7 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:27.951527 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-fe4da59d-7e95-43c5-a46b-3c577ce924a7 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:27.959259 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-fe4da59d-7e95-43c5-a46b-3c577ce924a7 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6" status: 200 len: 1313 microversion: 2.1 time: 0.167872 Jul 31 14:24:27.960378 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 120/257] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:27 2022] GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:28.465133 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5cbce022-92b5-4a7e-a657-03b0a302689a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:28.465818 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-5cbce022-92b5-4a7e-a657-03b0a302689a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:28.472877 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5cbce022-92b5-4a7e-a657-03b0a302689a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:28.473401 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5cbce022-92b5-4a7e-a657-03b0a302689a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:28.474236 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5cbce022-92b5-4a7e-a657-03b0a302689a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:28.474801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5cbce022-92b5-4a7e-a657-03b0a302689a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:28.630422 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-5cbce022-92b5-4a7e-a657-03b0a302689a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:28.639468 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-5cbce022-92b5-4a7e-a657-03b0a302689a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.178936 Jul 31 14:24:28.654373 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 138/258] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:28 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:24:28.981743 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-c9e0fc24-9dac-4908-a3e3-f8a1ae8b8384 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:28.982349 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-c9e0fc24-9dac-4908-a3e3-f8a1ae8b8384 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:28.988493 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c9e0fc24-9dac-4908-a3e3-f8a1ae8b8384 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:28.988937 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c9e0fc24-9dac-4908-a3e3-f8a1ae8b8384 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:28.989696 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c9e0fc24-9dac-4908-a3e3-f8a1ae8b8384 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:28.990128 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c9e0fc24-9dac-4908-a3e3-f8a1ae8b8384 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:29.199142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c9e0fc24-9dac-4908-a3e3-f8a1ae8b8384 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:29.209285 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-c9e0fc24-9dac-4908-a3e3-f8a1ae8b8384 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6" status: 200 len: 1313 microversion: 2.1 time: 0.231256 Jul 31 14:24:29.211824 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 121/259] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:28 2022] GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:29.661551 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e5ea50a0-a75f-4a7f-8663-24500071df23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:29.662167 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e5ea50a0-a75f-4a7f-8663-24500071df23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:29.669342 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e5ea50a0-a75f-4a7f-8663-24500071df23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:29.669790 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e5ea50a0-a75f-4a7f-8663-24500071df23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:29.670555 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e5ea50a0-a75f-4a7f-8663-24500071df23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:29.670987 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e5ea50a0-a75f-4a7f-8663-24500071df23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:29.861995 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e5ea50a0-a75f-4a7f-8663-24500071df23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:29.870786 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:24:29.874436 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e5ea50a0-a75f-4a7f-8663-24500071df23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.216471 Jul 31 14:24:29.875172 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 139/260] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:29 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:30.232481 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7ad8797e-6ae0-479e-8202-839c51b11c54 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:30.233017 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7ad8797e-6ae0-479e-8202-839c51b11c54 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:30.239516 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7ad8797e-6ae0-479e-8202-839c51b11c54 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:30.240012 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7ad8797e-6ae0-479e-8202-839c51b11c54 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:30.241439 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7ad8797e-6ae0-479e-8202-839c51b11c54 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:30.242091 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7ad8797e-6ae0-479e-8202-839c51b11c54 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:30.401063 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7ad8797e-6ae0-479e-8202-839c51b11c54 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:30.409115 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7ad8797e-6ae0-479e-8202-839c51b11c54 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6" status: 200 len: 1498 microversion: 2.1 time: 0.180666 Jul 31 14:24:30.419731 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 122/261] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:30 2022] GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6 => generated 1498 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:30.895722 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7edd3f97-8a59-4f34-aa13-998960c137ce tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:30.896335 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7edd3f97-8a59-4f34-aa13-998960c137ce tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:30.905448 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7edd3f97-8a59-4f34-aa13-998960c137ce tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:30.905616 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7edd3f97-8a59-4f34-aa13-998960c137ce tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:30.906456 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7edd3f97-8a59-4f34-aa13-998960c137ce tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:30.906950 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7edd3f97-8a59-4f34-aa13-998960c137ce tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:31.109526 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7edd3f97-8a59-4f34-aa13-998960c137ce tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:31.115081 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-47cd9a84-cfaf-4d51-b91c-e567d8c69769 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:31.115610 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-47cd9a84-cfaf-4d51-b91c-e567d8c69769 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:31.118455 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7edd3f97-8a59-4f34-aa13-998960c137ce tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.226476 Jul 31 14:24:31.119572 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 140/262] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:30 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:31.136372 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-47cd9a84-cfaf-4d51-b91c-e567d8c69769 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:31.137059 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-47cd9a84-cfaf-4d51-b91c-e567d8c69769 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:31.138097 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-47cd9a84-cfaf-4d51-b91c-e567d8c69769 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:31.140408 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-47cd9a84-cfaf-4d51-b91c-e567d8c69769 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:31.173328 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-47cd9a84-cfaf-4d51-b91c-e567d8c69769 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] Going to try to terminate instance {{(pid=117781) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 14:24:31.260993 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-47cd9a84-cfaf-4d51-b91c-e567d8c69769 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "DELETE /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6" status: 204 len: 0 microversion: 2.1 time: 0.156425 Jul 31 14:24:31.261700 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 123/263] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:24:31 2022] DELETE /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 14:24:31.270576 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b8a94e5a-5a88-4ee3-9405-33f3d9c26a76 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:31.271474 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b8a94e5a-5a88-4ee3-9405-33f3d9c26a76 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:31.282435 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b8a94e5a-5a88-4ee3-9405-33f3d9c26a76 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:31.283201 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b8a94e5a-5a88-4ee3-9405-33f3d9c26a76 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:31.284345 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b8a94e5a-5a88-4ee3-9405-33f3d9c26a76 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:31.285032 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b8a94e5a-5a88-4ee3-9405-33f3d9c26a76 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:31.448340 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b8a94e5a-5a88-4ee3-9405-33f3d9c26a76 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:31.458001 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b8a94e5a-5a88-4ee3-9405-33f3d9c26a76 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6" status: 200 len: 1504 microversion: 2.1 time: 0.191357 Jul 31 14:24:31.458569 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 141/264] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:31 2022] GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6 => generated 1504 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:32.140518 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-5f802490-44d0-4877-97b2-5ee0f507cd11 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:32.141213 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-5f802490-44d0-4877-97b2-5ee0f507cd11 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:32.159141 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5f802490-44d0-4877-97b2-5ee0f507cd11 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:32.159645 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5f802490-44d0-4877-97b2-5ee0f507cd11 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:32.160440 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5f802490-44d0-4877-97b2-5ee0f507cd11 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:32.160952 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5f802490-44d0-4877-97b2-5ee0f507cd11 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:32.333362 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-5f802490-44d0-4877-97b2-5ee0f507cd11 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:32.342122 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-5f802490-44d0-4877-97b2-5ee0f507cd11 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.205795 Jul 31 14:24:32.342708 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 124/265] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:32 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:32.480207 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f7aebdc1-dfc7-4061-9234-4a84d9e4c365 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:32.480819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f7aebdc1-dfc7-4061-9234-4a84d9e4c365 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:32.491995 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f7aebdc1-dfc7-4061-9234-4a84d9e4c365 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:32.492801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f7aebdc1-dfc7-4061-9234-4a84d9e4c365 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:32.493596 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f7aebdc1-dfc7-4061-9234-4a84d9e4c365 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:32.494033 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f7aebdc1-dfc7-4061-9234-4a84d9e4c365 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:32.667184 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f7aebdc1-dfc7-4061-9234-4a84d9e4c365 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:32.683406 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f7aebdc1-dfc7-4061-9234-4a84d9e4c365 tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6" status: 200 len: 1504 microversion: 2.1 time: 0.207010 Jul 31 14:24:32.690654 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 142/266] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:32 2022] GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6 => generated 1504 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:33.368528 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7791aea4-69b9-4a13-80ab-72abb3e78f9d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:33.369069 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7791aea4-69b9-4a13-80ab-72abb3e78f9d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:33.375076 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7791aea4-69b9-4a13-80ab-72abb3e78f9d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:33.375568 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7791aea4-69b9-4a13-80ab-72abb3e78f9d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:33.376336 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7791aea4-69b9-4a13-80ab-72abb3e78f9d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:33.376775 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7791aea4-69b9-4a13-80ab-72abb3e78f9d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:33.395024 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:24:33.593503 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7791aea4-69b9-4a13-80ab-72abb3e78f9d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:33.602924 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-932a9234-9fd6-41b3-9fe1-7615984ed594 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:33.603454 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7791aea4-69b9-4a13-80ab-72abb3e78f9d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.239159 Jul 31 14:24:33.603540 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-932a9234-9fd6-41b3-9fe1-7615984ed594 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:33.604124 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 125/267] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:33 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:33.609976 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-932a9234-9fd6-41b3-9fe1-7615984ed594 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:33.610490 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-932a9234-9fd6-41b3-9fe1-7615984ed594 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:33.611303 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-932a9234-9fd6-41b3-9fe1-7615984ed594 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:33.611770 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-932a9234-9fd6-41b3-9fe1-7615984ed594 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:33.640568 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-932a9234-9fd6-41b3-9fe1-7615984ed594 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b/ips" status: 200 len: 151 microversion: 2.1 time: 0.042852 Jul 31 14:24:33.641141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 143/268] 10.222.0.40 () {58 vars in 1248 bytes} [Sun Jul 31 14:24:33 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:24:33.712989 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-f7666014-a6f7-42fc-ad78-45a28179391a tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:33.713703 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-f7666014-a6f7-42fc-ad78-45a28179391a tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:33.720273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f7666014-a6f7-42fc-ad78-45a28179391a tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:33.721221 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f7666014-a6f7-42fc-ad78-45a28179391a tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:33.722226 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f7666014-a6f7-42fc-ad78-45a28179391a tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:33.723088 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f7666014-a6f7-42fc-ad78-45a28179391a tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:34.004888 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-f7666014-a6f7-42fc-ad78-45a28179391a tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33866c1c77541a4bfd12d441e7ab175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8656d0df1af4475b502efe677f7308e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:34.016238 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-f7666014-a6f7-42fc-ad78-45a28179391a tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6" status: 200 len: 1504 microversion: 2.1 time: 0.307456 Jul 31 14:24:34.021484 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 126/269] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:33 2022] GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6 => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:34.071732 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-f3ef6de4-e12e-44b1-a4c6-e0148106e03c req-f9028e81-3da8-45cd-87d0-7b9963b0a225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f26e8fa-7258-4095-9b2f-22864303f9a6", "name": "network-vif-deleted", "tag": "03e23c1b-3995-4bf1-8f91-a0cab5a727db"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:24:34.087871 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-f3ef6de4-e12e-44b1-a4c6-e0148106e03c req-f9028e81-3da8-45cd-87d0-7b9963b0a225 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:34.088568 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-f3ef6de4-e12e-44b1-a4c6-e0148106e03c req-f9028e81-3da8-45cd-87d0-7b9963b0a225 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:34.101949 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-f3ef6de4-e12e-44b1-a4c6-e0148106e03c req-f9028e81-3da8-45cd-87d0-7b9963b0a225 service nova] Creating event network-vif-deleted:03e23c1b-3995-4bf1-8f91-a0cab5a727db for instance 5f26e8fa-7258-4095-9b2f-22864303f9a6 on hv-cinder-84984 Jul 31 14:24:34.108682 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-f3ef6de4-e12e-44b1-a4c6-e0148106e03c req-f9028e81-3da8-45cd-87d0-7b9963b0a225 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041712 Jul 31 14:24:34.109674 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 144/270] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:24:34.625010 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-1bc7a7e0-f174-4fbb-a9f5-dcb80e996438 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:34.625517 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-1bc7a7e0-f174-4fbb-a9f5-dcb80e996438 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:34.631512 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1bc7a7e0-f174-4fbb-a9f5-dcb80e996438 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:34.631964 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1bc7a7e0-f174-4fbb-a9f5-dcb80e996438 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:34.632725 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1bc7a7e0-f174-4fbb-a9f5-dcb80e996438 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:34.633159 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1bc7a7e0-f174-4fbb-a9f5-dcb80e996438 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:34.779482 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-1bc7a7e0-f174-4fbb-a9f5-dcb80e996438 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:34.788270 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-1bc7a7e0-f174-4fbb-a9f5-dcb80e996438 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.166603 Jul 31 14:24:34.789169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 127/271] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:34 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:35.042141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f44cfe56-0dde-4daf-ade2-2a8ec4929a0e tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:35.042724 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f44cfe56-0dde-4daf-ade2-2a8ec4929a0e tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] [instance: 5f26e8fa-7258-4095-9b2f-22864303f9a6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:35.049513 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f44cfe56-0dde-4daf-ade2-2a8ec4929a0e tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:35.049984 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f44cfe56-0dde-4daf-ade2-2a8ec4929a0e tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:35.050824 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f44cfe56-0dde-4daf-ade2-2a8ec4929a0e tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:35.051252 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f44cfe56-0dde-4daf-ade2-2a8ec4929a0e tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:35.065001 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-f44cfe56-0dde-4daf-ade2-2a8ec4929a0e tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] HTTP exception thrown: Instance 5f26e8fa-7258-4095-9b2f-22864303f9a6 could not be found. Jul 31 14:24:35.066616 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f44cfe56-0dde-4daf-ade2-2a8ec4929a0e tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Request method failure captured: Jul 31 14:24:35.066616 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6 HTTP/1.1 Jul 31 14:24:35.066616 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:24:35.066616 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:24:35.066616 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:24:35.066616 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:24:35.066616 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:24:35.066616 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:24:35.066616 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:24:35.066616 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:24:35.066616 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pBt_aqMsMf9HaezdXslAYdYsG5PmbDe1CTM7G_hH6xUaEU-Pe2wMVvnd3hLTa3BuMBEdMdgZmmqPnV8OAYJc8jkIf6MCsSHgX_2R3nf4jN8WMKY-lixdxVxNYS1aDxMHI-6PCdZe0X17wfZPlgbu8Gg9F7YjO63zHUWHRZpvF3fQsU Jul 31 14:24:35.066616 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:24:35.066616 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:24:35.066616 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:24:35.066616 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:24:35.066616 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:24:35.066616 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:24:35.066616 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: b8656d0df1af4475b502efe677f7308e Jul 31 14:24:35.066616 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-VolumesActionsTest-881332668 Jul 31 14:24:35.066616 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:24:35.066616 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:24:35.068098 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b8656d0df1af4475b502efe677f7308e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b8656d0df1af4475b502efe677f7308e", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b8656d0df1af4475b502efe677f7308e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b8656d0df1af4475b502efe677f7308e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:24:35.068098 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-VolumesActionsTest-881332668 Jul 31 14:24:35.068098 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: b8656d0df1af4475b502efe677f7308e Jul 31 14:24:35.068098 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-VolumesActionsTest-881332668 Jul 31 14:24:35.068098 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-VolumesActionsTest-881332668-project Jul 31 14:24:35.068098 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:24:35.068098 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:24:35.068098 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: d33866c1c77541a4bfd12d441e7ab175 Jul 31 14:24:35.068098 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-VolumesActionsTest-881332668-project Jul 31 14:24:35.068098 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:24:35.068098 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance 5f26e8fa-7258-4095-9b2f-22864303f9a6 could not be found. Jul 31 14:24:35.068098 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': '5f26e8fa-7258-4095-9b2f-22864303f9a6'} Jul 31 14:24:35.069495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:24:35.069495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:35.069495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:24:35.069495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:24:35.069495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:24:35.069495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:24:35.069495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:24:35.069495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:24:35.069495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:24:35.069495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:24:35.069495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f26e8fa-7258-4095-9b2f-22864303f9a6 could not be found. Jul 31 14:24:35.069495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:35.069495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:35.069495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:35.069495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:35.069495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:24:35.069495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:24:35.069495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:24:35.069495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:24:35.069495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:24:35.071119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:24:35.071119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:24:35.071119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:24:35.071119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:24:35.071119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:24:35.071119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:24:35.071119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:24:35.071119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f26e8fa-7258-4095-9b2f-22864303f9a6 could not be found. Jul 31 14:24:35.071119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:35.071119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:24:35.071119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:35.071119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:24:35.071119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:24:35.071119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:24:35.071119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:24:35.071119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:24:35.071119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f26e8fa-7258-4095-9b2f-22864303f9a6 could not be found. Jul 31 14:24:35.071119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:24:35.073246 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f44cfe56-0dde-4daf-ade2-2a8ec4929a0e tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] Returning 404 to user: Instance 5f26e8fa-7258-4095-9b2f-22864303f9a6 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:24:35.073246 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f44cfe56-0dde-4daf-ade2-2a8ec4929a0e tempest-VolumesActionsTest-881332668 tempest-VolumesActionsTest-881332668-project] 10.222.0.40 "GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6" status: 404 len: 111 microversion: 2.1 time: 0.030202 Jul 31 14:24:35.073246 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 145/272] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:35 2022] GET /compute/v2.1/servers/5f26e8fa-7258-4095-9b2f-22864303f9a6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:24:35.114649 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-d234f524-665c-449f-a3e2-7f2525f35dd9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b54d681e-8d1b-4645-827c-e1e2122ae289"}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:24:35.117687 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-d234f524-665c-449f-a3e2-7f2525f35dd9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:35.132650 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d234f524-665c-449f-a3e2-7f2525f35dd9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:35.133142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d234f524-665c-449f-a3e2-7f2525f35dd9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:35.134181 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d234f524-665c-449f-a3e2-7f2525f35dd9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:35.134623 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d234f524-665c-449f-a3e2-7f2525f35dd9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:35.463172 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-d234f524-665c-449f-a3e2-7f2525f35dd9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "POST /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.352479 Jul 31 14:24:35.463859 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 128/273] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Jul 31 14:24:35 2022] POST /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b/os-volume_attachments => generated 194 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:24:35.808477 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-90026177-fa1e-4b45-aeb8-27488ba5f21b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:35.809188 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-90026177-fa1e-4b45-aeb8-27488ba5f21b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:35.815518 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-90026177-fa1e-4b45-aeb8-27488ba5f21b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:35.816018 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-90026177-fa1e-4b45-aeb8-27488ba5f21b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:35.816844 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-90026177-fa1e-4b45-aeb8-27488ba5f21b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:35.817354 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-90026177-fa1e-4b45-aeb8-27488ba5f21b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:35.957837 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-90026177-fa1e-4b45-aeb8-27488ba5f21b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:35.966933 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-90026177-fa1e-4b45-aeb8-27488ba5f21b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.162280 Jul 31 14:24:35.980465 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 146/274] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:35 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:24:36.991294 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-d9704433-9694-4c5a-841a-20fbab693679 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:36.991995 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-d9704433-9694-4c5a-841a-20fbab693679 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:36.999826 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d9704433-9694-4c5a-841a-20fbab693679 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:37.000275 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d9704433-9694-4c5a-841a-20fbab693679 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:37.001053 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d9704433-9694-4c5a-841a-20fbab693679 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:37.001526 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d9704433-9694-4c5a-841a-20fbab693679 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:37.106914 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=4 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:24:37.146090 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-d9704433-9694-4c5a-841a-20fbab693679 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:37.153762 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-d9704433-9694-4c5a-841a-20fbab693679 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.169222 Jul 31 14:24:37.154326 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 129/275] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:36 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:38.173799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-edc4bde2-6f6e-4a9d-88ce-97a14d22ac42 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:38.174398 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-edc4bde2-6f6e-4a9d-88ce-97a14d22ac42 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:38.180861 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-edc4bde2-6f6e-4a9d-88ce-97a14d22ac42 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:38.181302 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-edc4bde2-6f6e-4a9d-88ce-97a14d22ac42 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:38.182071 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-edc4bde2-6f6e-4a9d-88ce-97a14d22ac42 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:38.182752 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-edc4bde2-6f6e-4a9d-88ce-97a14d22ac42 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:38.312878 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-edc4bde2-6f6e-4a9d-88ce-97a14d22ac42 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:38.321182 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-edc4bde2-6f6e-4a9d-88ce-97a14d22ac42 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.151097 Jul 31 14:24:38.321736 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 147/276] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:38 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:38.527996 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-dadbaad3-af30-46a1-b3ea-f572159354ba tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:38.528528 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-dadbaad3-af30-46a1-b3ea-f572159354ba tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:38.534994 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dadbaad3-af30-46a1-b3ea-f572159354ba tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:38.535467 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dadbaad3-af30-46a1-b3ea-f572159354ba tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:38.536237 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dadbaad3-af30-46a1-b3ea-f572159354ba tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:38.536677 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dadbaad3-af30-46a1-b3ea-f572159354ba tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:38.560727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-dadbaad3-af30-46a1-b3ea-f572159354ba tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81/ips" status: 200 len: 152 microversion: 2.20 time: 0.036554 Jul 31 14:24:38.561305 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 130/277] 10.222.0.40 () {60 vars in 1289 bytes} [Sun Jul 31 14:24:38 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 14:24:39.342016 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7f735f30-b4e7-476e-8823-58128c18efb7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:39.342552 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7f735f30-b4e7-476e-8823-58128c18efb7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:39.349146 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7f735f30-b4e7-476e-8823-58128c18efb7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:39.350801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7f735f30-b4e7-476e-8823-58128c18efb7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:39.351197 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7f735f30-b4e7-476e-8823-58128c18efb7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:39.351752 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7f735f30-b4e7-476e-8823-58128c18efb7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:39.480120 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7f735f30-b4e7-476e-8823-58128c18efb7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:39.487651 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7f735f30-b4e7-476e-8823-58128c18efb7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.149482 Jul 31 14:24:39.488214 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 148/278] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:39 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:40.508947 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-dd1473bd-bfb9-4ec5-9ac7-70092a5249c9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:40.509874 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-dd1473bd-bfb9-4ec5-9ac7-70092a5249c9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:40.517092 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dd1473bd-bfb9-4ec5-9ac7-70092a5249c9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:40.517987 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dd1473bd-bfb9-4ec5-9ac7-70092a5249c9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:40.519003 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dd1473bd-bfb9-4ec5-9ac7-70092a5249c9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:40.519608 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dd1473bd-bfb9-4ec5-9ac7-70092a5249c9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:40.658776 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-dd1473bd-bfb9-4ec5-9ac7-70092a5249c9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:40.667117 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-dd1473bd-bfb9-4ec5-9ac7-70092a5249c9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.162421 Jul 31 14:24:40.667723 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 131/279] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:40 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:41.691720 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8bee43c9-d960-4b04-b2dc-e22ded463170 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:41.692686 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8bee43c9-d960-4b04-b2dc-e22ded463170 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:41.700471 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8bee43c9-d960-4b04-b2dc-e22ded463170 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:41.701166 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8bee43c9-d960-4b04-b2dc-e22ded463170 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:41.702231 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8bee43c9-d960-4b04-b2dc-e22ded463170 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:41.702675 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8bee43c9-d960-4b04-b2dc-e22ded463170 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:41.870213 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8bee43c9-d960-4b04-b2dc-e22ded463170 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:41.884462 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8bee43c9-d960-4b04-b2dc-e22ded463170 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.198250 Jul 31 14:24:41.886351 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 149/280] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:41 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:42.092314 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-561e083b-10ae-4ea6-8e3b-e38fcbd41cbb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:24:42.093460 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-561e083b-10ae-4ea6-8e3b-e38fcbd41cbb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:42.101093 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-561e083b-10ae-4ea6-8e3b-e38fcbd41cbb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:42.101789 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-561e083b-10ae-4ea6-8e3b-e38fcbd41cbb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:42.102758 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-561e083b-10ae-4ea6-8e3b-e38fcbd41cbb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:42.103476 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-561e083b-10ae-4ea6-8e3b-e38fcbd41cbb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:42.289394 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.objects.instance [None req-561e083b-10ae-4ea6-8e3b-e38fcbd41cbb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lazy-loading 'flavor' on Instance uuid d0810b36-49ee-482b-9e65-f587148b2a81 {{(pid=117781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:24:42.910943 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8d1e9ae7-0693-49d8-9683-3481e2420437 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:42.914381 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8d1e9ae7-0693-49d8-9683-3481e2420437 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:42.925539 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8d1e9ae7-0693-49d8-9683-3481e2420437 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:42.926481 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8d1e9ae7-0693-49d8-9683-3481e2420437 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:42.927512 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8d1e9ae7-0693-49d8-9683-3481e2420437 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:42.929182 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8d1e9ae7-0693-49d8-9683-3481e2420437 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:43.105403 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8d1e9ae7-0693-49d8-9683-3481e2420437 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:43.113105 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8d1e9ae7-0693-49d8-9683-3481e2420437 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.208191 Jul 31 14:24:43.113699 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 150/281] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:42 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:44.136400 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-356e2f26-6446-4a29-a1e1-63335608c25b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:44.137150 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-356e2f26-6446-4a29-a1e1-63335608c25b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:44.148404 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=54 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:24:44.152676 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-356e2f26-6446-4a29-a1e1-63335608c25b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:44.154329 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-356e2f26-6446-4a29-a1e1-63335608c25b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:44.155471 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-356e2f26-6446-4a29-a1e1-63335608c25b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:44.159272 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-356e2f26-6446-4a29-a1e1-63335608c25b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:44.368991 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-356e2f26-6446-4a29-a1e1-63335608c25b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:44.377550 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-356e2f26-6446-4a29-a1e1-63335608c25b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.245096 Jul 31 14:24:44.392308 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 151/282] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:44 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:45.400520 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-36305fca-3e7c-4b53-867d-8156cecbea3d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:45.402020 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-36305fca-3e7c-4b53-867d-8156cecbea3d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:45.409828 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-36305fca-3e7c-4b53-867d-8156cecbea3d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:45.410638 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-36305fca-3e7c-4b53-867d-8156cecbea3d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:45.412144 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-36305fca-3e7c-4b53-867d-8156cecbea3d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:45.413407 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-36305fca-3e7c-4b53-867d-8156cecbea3d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:45.647498 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-36305fca-3e7c-4b53-867d-8156cecbea3d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:45.655029 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-36305fca-3e7c-4b53-867d-8156cecbea3d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.258814 Jul 31 14:24:45.655561 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 152/283] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:45 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:46.676089 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d7bba980-de05-492f-96e6-2e7f7051f485 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:46.676717 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d7bba980-de05-492f-96e6-2e7f7051f485 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:46.683908 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d7bba980-de05-492f-96e6-2e7f7051f485 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:46.684356 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d7bba980-de05-492f-96e6-2e7f7051f485 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:46.685115 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d7bba980-de05-492f-96e6-2e7f7051f485 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:46.685548 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d7bba980-de05-492f-96e6-2e7f7051f485 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:46.824142 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d7bba980-de05-492f-96e6-2e7f7051f485 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:46.832033 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d7bba980-de05-492f-96e6-2e7f7051f485 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.159866 Jul 31 14:24:46.832597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 153/284] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:46 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:24:47.853572 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6b9d11e2-c890-4993-ae5a-9e68eb737dd0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:47.854396 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6b9d11e2-c890-4993-ae5a-9e68eb737dd0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:47.860993 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6b9d11e2-c890-4993-ae5a-9e68eb737dd0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:47.861447 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6b9d11e2-c890-4993-ae5a-9e68eb737dd0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:47.862217 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6b9d11e2-c890-4993-ae5a-9e68eb737dd0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:47.862653 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6b9d11e2-c890-4993-ae5a-9e68eb737dd0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:48.013713 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6b9d11e2-c890-4993-ae5a-9e68eb737dd0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:48.023034 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6b9d11e2-c890-4993-ae5a-9e68eb737dd0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.173858 Jul 31 14:24:48.030217 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 154/285] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:47 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:24:49.044908 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b26a4bee-e237-4d6e-af49-30ae95820953 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:49.045583 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b26a4bee-e237-4d6e-af49-30ae95820953 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:49.052015 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b26a4bee-e237-4d6e-af49-30ae95820953 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:49.052452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b26a4bee-e237-4d6e-af49-30ae95820953 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:49.053812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b26a4bee-e237-4d6e-af49-30ae95820953 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:49.054273 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b26a4bee-e237-4d6e-af49-30ae95820953 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:49.210788 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b26a4bee-e237-4d6e-af49-30ae95820953 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:49.224612 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b26a4bee-e237-4d6e-af49-30ae95820953 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.183385 Jul 31 14:24:49.225185 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 155/286] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:49 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:24:50.246420 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4d346b36-31a2-4cef-83ac-f65ddfb87d14 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:50.247136 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4d346b36-31a2-4cef-83ac-f65ddfb87d14 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:50.253921 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4d346b36-31a2-4cef-83ac-f65ddfb87d14 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:50.254638 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4d346b36-31a2-4cef-83ac-f65ddfb87d14 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:50.255629 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4d346b36-31a2-4cef-83ac-f65ddfb87d14 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:50.256754 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4d346b36-31a2-4cef-83ac-f65ddfb87d14 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:50.398011 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4d346b36-31a2-4cef-83ac-f65ddfb87d14 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:50.406029 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4d346b36-31a2-4cef-83ac-f65ddfb87d14 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.163452 Jul 31 14:24:50.406934 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 156/287] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:50 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:51.429604 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c401fed0-bb0c-42b5-bd85-bf277d18a762 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:51.430267 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c401fed0-bb0c-42b5-bd85-bf277d18a762 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:51.437693 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c401fed0-bb0c-42b5-bd85-bf277d18a762 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:51.438140 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c401fed0-bb0c-42b5-bd85-bf277d18a762 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:51.438891 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c401fed0-bb0c-42b5-bd85-bf277d18a762 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:51.439559 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c401fed0-bb0c-42b5-bd85-bf277d18a762 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:51.534208 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-561e083b-10ae-4ea6-8e3b-e38fcbd41cbb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "POST /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81/action" status: 202 len: 0 microversion: 2.20 time: 9.444199 Jul 31 14:24:51.536604 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 132/288] 10.222.0.40 () {62 vars in 1319 bytes} [Sun Jul 31 14:24:42 2022] POST /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81/action => generated 0 bytes in 9449 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 14:24:51.550708 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-158b5285-d1e0-4aa5-bf8c-d00b26fdce3e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:51.552115 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-158b5285-d1e0-4aa5-bf8c-d00b26fdce3e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:51.562109 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-158b5285-d1e0-4aa5-bf8c-d00b26fdce3e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:51.562982 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-158b5285-d1e0-4aa5-bf8c-d00b26fdce3e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:51.564245 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-158b5285-d1e0-4aa5-bf8c-d00b26fdce3e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:51.564954 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-158b5285-d1e0-4aa5-bf8c-d00b26fdce3e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:51.661151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c401fed0-bb0c-42b5-bd85-bf277d18a762 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:51.672613 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c401fed0-bb0c-42b5-bd85-bf277d18a762 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.247285 Jul 31 14:24:51.693621 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 157/289] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:51 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:51.776094 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-158b5285-d1e0-4aa5-bf8c-d00b26fdce3e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:51.797595 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-158b5285-d1e0-4aa5-bf8c-d00b26fdce3e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:51.800706 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-158b5285-d1e0-4aa5-bf8c-d00b26fdce3e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:51.802080 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-158b5285-d1e0-4aa5-bf8c-d00b26fdce3e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1724 microversion: 2.20 time: 0.260364 Jul 31 14:24:51.803514 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 133/290] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:24:51 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:24:52.694684 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-224cfeac-06ee-42fb-9ed7-a9b12ff2c8e6 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:52.695289 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-224cfeac-06ee-42fb-9ed7-a9b12ff2c8e6 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:52.702380 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-224cfeac-06ee-42fb-9ed7-a9b12ff2c8e6 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:52.702827 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-224cfeac-06ee-42fb-9ed7-a9b12ff2c8e6 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:52.703621 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-224cfeac-06ee-42fb-9ed7-a9b12ff2c8e6 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:52.704091 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-224cfeac-06ee-42fb-9ed7-a9b12ff2c8e6 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:52.708119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=100 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:24:52.828447 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b7db8efc-2b6a-4130-9083-c9eaf5b632af tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:52.829062 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b7db8efc-2b6a-4130-9083-c9eaf5b632af tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:52.836835 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b7db8efc-2b6a-4130-9083-c9eaf5b632af tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:52.837289 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b7db8efc-2b6a-4130-9083-c9eaf5b632af tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:52.838063 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b7db8efc-2b6a-4130-9083-c9eaf5b632af tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:52.838503 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b7db8efc-2b6a-4130-9083-c9eaf5b632af tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:52.841852 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-224cfeac-06ee-42fb-9ed7-a9b12ff2c8e6 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:52.853943 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-224cfeac-06ee-42fb-9ed7-a9b12ff2c8e6 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.163110 Jul 31 14:24:52.854706 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 158/291] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:52 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:52.985425 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b7db8efc-2b6a-4130-9083-c9eaf5b632af tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:52.994670 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b7db8efc-2b6a-4130-9083-c9eaf5b632af tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:52.996327 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b7db8efc-2b6a-4130-9083-c9eaf5b632af tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:52.997639 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b7db8efc-2b6a-4130-9083-c9eaf5b632af tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1724 microversion: 2.20 time: 0.174911 Jul 31 14:24:52.998243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 134/292] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:24:52 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:24:53.875618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8e003252-c68c-4544-b9f9-9c7cbe6dfffa tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:53.876325 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8e003252-c68c-4544-b9f9-9c7cbe6dfffa tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:53.899254 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8e003252-c68c-4544-b9f9-9c7cbe6dfffa tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:53.901408 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8e003252-c68c-4544-b9f9-9c7cbe6dfffa tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:53.905302 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8e003252-c68c-4544-b9f9-9c7cbe6dfffa tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:53.905960 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8e003252-c68c-4544-b9f9-9c7cbe6dfffa tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:54.027517 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-531d128e-a749-4c66-9127-6b2f2127ea78 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:54.028708 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-531d128e-a749-4c66-9127-6b2f2127ea78 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:54.035463 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-531d128e-a749-4c66-9127-6b2f2127ea78 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:54.036275 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-531d128e-a749-4c66-9127-6b2f2127ea78 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:54.037743 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-531d128e-a749-4c66-9127-6b2f2127ea78 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:54.038330 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-531d128e-a749-4c66-9127-6b2f2127ea78 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:54.123495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8e003252-c68c-4544-b9f9-9c7cbe6dfffa tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:54.151275 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8e003252-c68c-4544-b9f9-9c7cbe6dfffa tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.279858 Jul 31 14:24:54.151924 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 159/293] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:53 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:54.351201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-531d128e-a749-4c66-9127-6b2f2127ea78 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:54.360086 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-531d128e-a749-4c66-9127-6b2f2127ea78 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:54.362337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-531d128e-a749-4c66-9127-6b2f2127ea78 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:54.363802 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-531d128e-a749-4c66-9127-6b2f2127ea78 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1724 microversion: 2.20 time: 0.346256 Jul 31 14:24:54.364666 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 135/294] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:24:54 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1724 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:24:55.131383 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-76b19cf5-7fec-451e-aeaf-8922cab8af22 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Action: 'create', calling method: .version_select at 0x7f87eb8160d0>, body: {"keypair": {"name": "tempest-keypair-1022708853", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxpPv8pQ63BqwGRn1RW0oPIZgx5+1tHKo9LEjMUw2HhNXHYEElHlI5widIWgkksUgxyjNYam9Rq3Ydl8DGMrjjWd9LgmdOpqsNX/bMJi4u+YI0dFOSiTWoy5CStQ8adDQ=="}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:24:55.149072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-76b19cf5-7fec-451e-aeaf-8922cab8af22 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Getting quotas for project 9097fd66951e457ba46812ff17db7501. Resources: {'key_pairs'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:24:55.153682 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-76b19cf5-7fec-451e-aeaf-8922cab8af22 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Getting quotas for user d6e8399080a942f1b689fc8c6b42c717 and project 9097fd66951e457ba46812ff17db7501. Resources: {'key_pairs'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:24:55.174243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-59a04b7e-50f2-44d6-8b4e-b483b4cb919c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:55.174844 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-59a04b7e-50f2-44d6-8b4e-b483b4cb919c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:55.184402 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:24:55.187442 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-59a04b7e-50f2-44d6-8b4e-b483b4cb919c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:55.188167 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-59a04b7e-50f2-44d6-8b4e-b483b4cb919c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:55.189281 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-59a04b7e-50f2-44d6-8b4e-b483b4cb919c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:55.189725 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-59a04b7e-50f2-44d6-8b4e-b483b4cb919c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:55.197738 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-76b19cf5-7fec-451e-aeaf-8922cab8af22 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070660 Jul 31 14:24:55.198340 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 160/295] 10.222.0.40 () {60 vars in 1159 bytes} [Sun Jul 31 14:24:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:24:55.399696 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ec7a2dd5-e91d-4bda-88b9-9d663a2ff572 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:55.400798 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ec7a2dd5-e91d-4bda-88b9-9d663a2ff572 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:55.410585 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ec7a2dd5-e91d-4bda-88b9-9d663a2ff572 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:55.411414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ec7a2dd5-e91d-4bda-88b9-9d663a2ff572 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:55.413147 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ec7a2dd5-e91d-4bda-88b9-9d663a2ff572 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:55.413811 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ec7a2dd5-e91d-4bda-88b9-9d663a2ff572 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:55.799901 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-59a04b7e-50f2-44d6-8b4e-b483b4cb919c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:55.812486 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-59a04b7e-50f2-44d6-8b4e-b483b4cb919c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.641837 Jul 31 14:24:55.822490 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 136/296] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:55 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:24:55.835454 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ec7a2dd5-e91d-4bda-88b9-9d663a2ff572 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:55.850761 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ec7a2dd5-e91d-4bda-88b9-9d663a2ff572 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:55.853133 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ec7a2dd5-e91d-4bda-88b9-9d663a2ff572 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:55.854620 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ec7a2dd5-e91d-4bda-88b9-9d663a2ff572 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1724 microversion: 2.20 time: 0.462508 Jul 31 14:24:55.860382 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 161/297] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:24:55 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1724 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:24:56.840126 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b176ce89-8e20-4b31-bb85-562e493a17f0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:56.843851 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b176ce89-8e20-4b31-bb85-562e493a17f0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:56.854919 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b176ce89-8e20-4b31-bb85-562e493a17f0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:56.856176 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b176ce89-8e20-4b31-bb85-562e493a17f0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:56.857247 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b176ce89-8e20-4b31-bb85-562e493a17f0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:56.857780 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b176ce89-8e20-4b31-bb85-562e493a17f0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:56.889520 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7fb1c3c7-1cc7-41d6-b53f-e636bf3e25d5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:56.890423 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7fb1c3c7-1cc7-41d6-b53f-e636bf3e25d5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:56.898285 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7fb1c3c7-1cc7-41d6-b53f-e636bf3e25d5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:56.898848 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7fb1c3c7-1cc7-41d6-b53f-e636bf3e25d5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:56.900059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7fb1c3c7-1cc7-41d6-b53f-e636bf3e25d5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:56.900604 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7fb1c3c7-1cc7-41d6-b53f-e636bf3e25d5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:57.078449 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7fb1c3c7-1cc7-41d6-b53f-e636bf3e25d5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:57.094934 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7fb1c3c7-1cc7-41d6-b53f-e636bf3e25d5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:57.096562 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7fb1c3c7-1cc7-41d6-b53f-e636bf3e25d5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:57.098025 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7fb1c3c7-1cc7-41d6-b53f-e636bf3e25d5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1724 microversion: 2.20 time: 0.213395 Jul 31 14:24:57.099067 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 162/298] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:24:56 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:24:57.132577 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b176ce89-8e20-4b31-bb85-562e493a17f0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:57.147985 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b176ce89-8e20-4b31-bb85-562e493a17f0 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.311419 Jul 31 14:24:57.150182 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e78b62d5-40b6-48f5-b474-bce822bdd2d9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-898584239", "imageRef": "57bc051a-64d0-4317-aa93-a7a2aed39369", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cbc0073a-ae55-48a9-8514-9052086eccf8"}], "security_groups": [{"name": "tempest-securitygroup--2048952643"}], "key_name": "tempest-keypair-1022708853", "user_data": "}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:24:57.164393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 137/299] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:56 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:57.700536 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7337e9d2-9b08-4a47-8b0e-90ee9fb4a9b2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1739560095", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-56261385", "security_groups": [{"name": "tempest-secgroup-smoke-1003730363"}], "networks": [{"uuid": "678e7fb8-a8c3-4462-826a-1ccec549b8ba"}], "block_device_mapping_v2": [{"uuid": "c7b85345-a44c-45bf-9e94-9db9868ba295", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:24:57.832546 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.network.neutron [None req-7337e9d2-9b08-4a47-8b0e-90ee9fb4a9b2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] validate_networks() for [('678e7fb8-a8c3-4462-826a-1ccec549b8ba', None, None, None, None, None)] {{(pid=117781) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 14:24:58.234690 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-7337e9d2-9b08-4a47-8b0e-90ee9fb4a9b2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Flavor limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 14:24:58.235751 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-7337e9d2-9b08-4a47-8b0e-90ee9fb4a9b2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Image limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 14:24:58.236415 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-7337e9d2-9b08-4a47-8b0e-90ee9fb4a9b2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Flavor pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 14:24:58.236820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-7337e9d2-9b08-4a47-8b0e-90ee9fb4a9b2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Image pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 14:24:58.237245 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-7337e9d2-9b08-4a47-8b0e-90ee9fb4a9b2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 14:24:58.247333 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7337e9d2-9b08-4a47-8b0e-90ee9fb4a9b2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:58.247825 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7337e9d2-9b08-4a47-8b0e-90ee9fb4a9b2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:58.248936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7337e9d2-9b08-4a47-8b0e-90ee9fb4a9b2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:58.249384 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7337e9d2-9b08-4a47-8b0e-90ee9fb4a9b2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:58.267279 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-7337e9d2-9b08-4a47-8b0e-90ee9fb4a9b2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Getting quotas for project d9ff0edf56fa403e8b9bf25fe004cdd3. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:24:58.272524 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-7337e9d2-9b08-4a47-8b0e-90ee9fb4a9b2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Getting quotas for user 26ca8614358245b99f621edc7f1d0021 and project d9ff0edf56fa403e8b9bf25fe004cdd3. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:24:58.339161 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7337e9d2-9b08-4a47-8b0e-90ee9fb4a9b2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Going to run 1 instances... {{(pid=117781) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 14:24:58.341358 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7337e9d2-9b08-4a47-8b0e-90ee9fb4a9b2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c7b85345-a44c-45bf-9e94-9db9868ba295',volume_size=None,volume_type=None)] {{(pid=117781) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 14:24:58.509586 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7337e9d2-9b08-4a47-8b0e-90ee9fb4a9b2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.813197 Jul 31 14:24:58.514248 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 138/300] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Jul 31 14:24:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 14:24:58.520317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-0424b457-633a-400f-aa34-9fd50cb04033 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:58.522412 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-0424b457-633a-400f-aa34-9fd50cb04033 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:58.529914 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0424b457-633a-400f-aa34-9fd50cb04033 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:58.530469 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0424b457-633a-400f-aa34-9fd50cb04033 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:58.531330 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0424b457-633a-400f-aa34-9fd50cb04033 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:58.531852 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0424b457-633a-400f-aa34-9fd50cb04033 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:58.973244 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-0424b457-633a-400f-aa34-9fd50cb04033 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:58.982018 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:24:58.987376 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-0424b457-633a-400f-aa34-9fd50cb04033 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:58.990970 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-0424b457-633a-400f-aa34-9fd50cb04033 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:58.992734 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-0424b457-633a-400f-aa34-9fd50cb04033 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1724 microversion: 2.20 time: 0.477261 Jul 31 14:24:58.995586 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 139/301] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:24:58 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1724 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:24:59.001376 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-9c4a139c-f80a-4fce-bae0-f2140cd61aa2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:59.002193 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-9c4a139c-f80a-4fce-bae0-f2140cd61aa2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:59.014319 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9c4a139c-f80a-4fce-bae0-f2140cd61aa2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:59.015127 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9c4a139c-f80a-4fce-bae0-f2140cd61aa2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:59.016058 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9c4a139c-f80a-4fce-bae0-f2140cd61aa2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:59.016758 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9c4a139c-f80a-4fce-bae0-f2140cd61aa2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:59.193102 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-9c4a139c-f80a-4fce-bae0-f2140cd61aa2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:59.203000 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-9c4a139c-f80a-4fce-bae0-f2140cd61aa2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.205984 Jul 31 14:24:59.204057 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 140/302] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:58 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:24:59.219787 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-ac3e6017-1228-4e05-969f-eae17f87f291 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:24:59.220890 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-ac3e6017-1228-4e05-969f-eae17f87f291 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:24:59.228451 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ac3e6017-1228-4e05-969f-eae17f87f291 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:59.229166 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ac3e6017-1228-4e05-969f-eae17f87f291 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:59.230115 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ac3e6017-1228-4e05-969f-eae17f87f291 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:24:59.230700 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ac3e6017-1228-4e05-969f-eae17f87f291 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:24:59.295583 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-ac3e6017-1228-4e05-969f-eae17f87f291 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:24:59.305038 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-ac3e6017-1228-4e05-969f-eae17f87f291 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1129 microversion: 2.1 time: 0.099179 Jul 31 14:24:59.305870 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 141/303] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:24:59 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1129 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:00.024569 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-5f601f64-a9db-4b07-bed4-b485882cc1d3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:00.025471 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-5f601f64-a9db-4b07-bed4-b485882cc1d3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:00.032537 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5f601f64-a9db-4b07-bed4-b485882cc1d3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:00.034509 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5f601f64-a9db-4b07-bed4-b485882cc1d3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:00.035567 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5f601f64-a9db-4b07-bed4-b485882cc1d3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:00.040420 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5f601f64-a9db-4b07-bed4-b485882cc1d3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:00.259578 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-5f601f64-a9db-4b07-bed4-b485882cc1d3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:00.267648 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-5f601f64-a9db-4b07-bed4-b485882cc1d3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:00.269154 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-5f601f64-a9db-4b07-bed4-b485882cc1d3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:00.270301 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-5f601f64-a9db-4b07-bed4-b485882cc1d3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1724 microversion: 2.20 time: 0.250052 Jul 31 14:25:00.271048 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 142/304] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:00 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:25:00.281722 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7a2c104d-8cc4-463d-b55e-311f38927c8a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:00.282916 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7a2c104d-8cc4-463d-b55e-311f38927c8a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:00.290332 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7a2c104d-8cc4-463d-b55e-311f38927c8a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:00.290773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7a2c104d-8cc4-463d-b55e-311f38927c8a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:00.291564 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7a2c104d-8cc4-463d-b55e-311f38927c8a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:00.291995 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7a2c104d-8cc4-463d-b55e-311f38927c8a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:00.533714 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7a2c104d-8cc4-463d-b55e-311f38927c8a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:00.543613 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7a2c104d-8cc4-463d-b55e-311f38927c8a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.271289 Jul 31 14:25:00.544540 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 143/305] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:00 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:00.549781 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-8c0f38e6-0978-4ae3-9aec-160972db3a0f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:00.550803 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-8c0f38e6-0978-4ae3-9aec-160972db3a0f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:00.561331 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8c0f38e6-0978-4ae3-9aec-160972db3a0f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:00.561893 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8c0f38e6-0978-4ae3-9aec-160972db3a0f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:00.562798 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8c0f38e6-0978-4ae3-9aec-160972db3a0f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:00.563558 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8c0f38e6-0978-4ae3-9aec-160972db3a0f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:00.690978 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-8c0f38e6-0978-4ae3-9aec-160972db3a0f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:00.705912 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-8c0f38e6-0978-4ae3-9aec-160972db3a0f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1203 microversion: 2.1 time: 0.159325 Jul 31 14:25:00.717843 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 144/306] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:00 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1203 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:01.294896 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-a7e21f41-fc4b-4244-bbed-f8371e3e961c tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:01.295681 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-a7e21f41-fc4b-4244-bbed-f8371e3e961c tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:01.302385 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a7e21f41-fc4b-4244-bbed-f8371e3e961c tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:01.303092 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a7e21f41-fc4b-4244-bbed-f8371e3e961c tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:01.304099 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a7e21f41-fc4b-4244-bbed-f8371e3e961c tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:01.304695 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a7e21f41-fc4b-4244-bbed-f8371e3e961c tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:01.546610 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a7e21f41-fc4b-4244-bbed-f8371e3e961c tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:01.555102 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a7e21f41-fc4b-4244-bbed-f8371e3e961c tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:01.556930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a7e21f41-fc4b-4244-bbed-f8371e3e961c tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:01.558329 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-a7e21f41-fc4b-4244-bbed-f8371e3e961c tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1724 microversion: 2.20 time: 0.267907 Jul 31 14:25:01.572336 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 145/307] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:01 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1724 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:25:01.611985 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7da06013-baa7-4d59-b85e-dad35bdaa241 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:01.613069 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7da06013-baa7-4d59-b85e-dad35bdaa241 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:01.620608 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7da06013-baa7-4d59-b85e-dad35bdaa241 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:01.621295 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7da06013-baa7-4d59-b85e-dad35bdaa241 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:01.622288 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7da06013-baa7-4d59-b85e-dad35bdaa241 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:01.622971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7da06013-baa7-4d59-b85e-dad35bdaa241 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:01.926209 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7da06013-baa7-4d59-b85e-dad35bdaa241 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:01.935970 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7da06013-baa7-4d59-b85e-dad35bdaa241 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.328384 Jul 31 14:25:01.936810 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 146/308] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:01 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:01.942090 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-9b95d78b-b177-440c-bf50-81df6daf85d8 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:01.942688 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-9b95d78b-b177-440c-bf50-81df6daf85d8 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:01.949994 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9b95d78b-b177-440c-bf50-81df6daf85d8 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:01.950753 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9b95d78b-b177-440c-bf50-81df6daf85d8 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:01.952122 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9b95d78b-b177-440c-bf50-81df6daf85d8 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:01.952568 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9b95d78b-b177-440c-bf50-81df6daf85d8 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:02.267002 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-9b95d78b-b177-440c-bf50-81df6daf85d8 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:02.276587 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-9b95d78b-b177-440c-bf50-81df6daf85d8 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1259 microversion: 2.1 time: 0.338000 Jul 31 14:25:02.276587 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 147/309] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:01 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1259 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:02.287455 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-197d5ac3-f228-40d2-b2c1-73ee54dc58c6 req-c2f0e1ce-f7f1-4375-9393-8a66a5cbf51d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92439dcd-76b3-44fb-882b-1b8f0dcb9d73", "tag": "e91303da-f1e0-49da-acae-3ce6750984f8"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:25:02.300573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-197d5ac3-f228-40d2-b2c1-73ee54dc58c6 req-c2f0e1ce-f7f1-4375-9393-8a66a5cbf51d service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:02.301011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-197d5ac3-f228-40d2-b2c1-73ee54dc58c6 req-c2f0e1ce-f7f1-4375-9393-8a66a5cbf51d service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:02.313453 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-197d5ac3-f228-40d2-b2c1-73ee54dc58c6 req-c2f0e1ce-f7f1-4375-9393-8a66a5cbf51d service nova] Creating event network-changed:e91303da-f1e0-49da-acae-3ce6750984f8 for instance 92439dcd-76b3-44fb-882b-1b8f0dcb9d73 on hv-cinder-84984 Jul 31 14:25:02.319494 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-197d5ac3-f228-40d2-b2c1-73ee54dc58c6 req-c2f0e1ce-f7f1-4375-9393-8a66a5cbf51d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041378 Jul 31 14:25:02.320307 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 148/310] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:25:02.588297 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-e6218627-db27-4a43-8021-55e0ab27b6da tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:02.589469 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-e6218627-db27-4a43-8021-55e0ab27b6da tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:02.597253 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e6218627-db27-4a43-8021-55e0ab27b6da tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:02.597713 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e6218627-db27-4a43-8021-55e0ab27b6da tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:02.598896 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e6218627-db27-4a43-8021-55e0ab27b6da tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:02.600247 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e6218627-db27-4a43-8021-55e0ab27b6da tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:02.780500 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e6218627-db27-4a43-8021-55e0ab27b6da tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:02.793875 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e6218627-db27-4a43-8021-55e0ab27b6da tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:02.796135 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e6218627-db27-4a43-8021-55e0ab27b6da tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:02.798573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-e6218627-db27-4a43-8021-55e0ab27b6da tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1724 microversion: 2.20 time: 0.217006 Jul 31 14:25:02.799398 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 149/311] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:02 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:02.961369 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-c65d218b-6c3e-403b-9f4b-cb183018dbb5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:02.963985 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-c65d218b-6c3e-403b-9f4b-cb183018dbb5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:02.972431 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c65d218b-6c3e-403b-9f4b-cb183018dbb5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:02.988781 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c65d218b-6c3e-403b-9f4b-cb183018dbb5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:02.990094 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c65d218b-6c3e-403b-9f4b-cb183018dbb5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:02.990777 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c65d218b-6c3e-403b-9f4b-cb183018dbb5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:03.220936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c65d218b-6c3e-403b-9f4b-cb183018dbb5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:03.229328 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-c65d218b-6c3e-403b-9f4b-cb183018dbb5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.273768 Jul 31 14:25:03.230078 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 150/312] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:02 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:03.302089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-a51ed79d-18ec-4eaa-b63f-f80a96d813b7 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:03.303299 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-a51ed79d-18ec-4eaa-b63f-f80a96d813b7 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:03.320779 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a51ed79d-18ec-4eaa-b63f-f80a96d813b7 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:03.321263 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a51ed79d-18ec-4eaa-b63f-f80a96d813b7 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:03.322254 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a51ed79d-18ec-4eaa-b63f-f80a96d813b7 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:03.323652 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a51ed79d-18ec-4eaa-b63f-f80a96d813b7 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:03.560904 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a51ed79d-18ec-4eaa-b63f-f80a96d813b7 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:03.569877 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-a51ed79d-18ec-4eaa-b63f-f80a96d813b7 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1259 microversion: 2.1 time: 0.271933 Jul 31 14:25:03.570771 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 151/313] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:03 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1259 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:03.823543 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-4cd170b7-c31c-45cf-8a30-2774319fdc80 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:03.824286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-4cd170b7-c31c-45cf-8a30-2774319fdc80 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:03.831400 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4cd170b7-c31c-45cf-8a30-2774319fdc80 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:03.831820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4cd170b7-c31c-45cf-8a30-2774319fdc80 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:03.832613 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4cd170b7-c31c-45cf-8a30-2774319fdc80 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:03.833071 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4cd170b7-c31c-45cf-8a30-2774319fdc80 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:03.978315 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-4cd170b7-c31c-45cf-8a30-2774319fdc80 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:03.988337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-4cd170b7-c31c-45cf-8a30-2774319fdc80 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:03.991223 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-4cd170b7-c31c-45cf-8a30-2774319fdc80 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:03.993230 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-4cd170b7-c31c-45cf-8a30-2774319fdc80 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1724 microversion: 2.20 time: 0.175438 Jul 31 14:25:04.008021 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 152/314] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:03 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:04.251740 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-ee87df3b-a703-4f92-970f-c225a4f82794 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:04.252705 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-ee87df3b-a703-4f92-970f-c225a4f82794 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:04.259367 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ee87df3b-a703-4f92-970f-c225a4f82794 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:04.259853 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ee87df3b-a703-4f92-970f-c225a4f82794 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:04.260620 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ee87df3b-a703-4f92-970f-c225a4f82794 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:04.261105 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ee87df3b-a703-4f92-970f-c225a4f82794 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:04.406236 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-ee87df3b-a703-4f92-970f-c225a4f82794 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:04.414683 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-ee87df3b-a703-4f92-970f-c225a4f82794 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.166908 Jul 31 14:25:04.415664 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 153/315] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:04 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:04.591443 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-84cef554-0682-4e3a-979a-13f88a857c14 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:04.592120 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-84cef554-0682-4e3a-979a-13f88a857c14 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:04.599931 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-84cef554-0682-4e3a-979a-13f88a857c14 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:04.600384 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-84cef554-0682-4e3a-979a-13f88a857c14 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:04.601384 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-84cef554-0682-4e3a-979a-13f88a857c14 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:04.601827 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-84cef554-0682-4e3a-979a-13f88a857c14 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:04.750442 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-84cef554-0682-4e3a-979a-13f88a857c14 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:04.763205 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-84cef554-0682-4e3a-979a-13f88a857c14 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1259 microversion: 2.1 time: 0.175746 Jul 31 14:25:04.771823 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 154/316] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:04 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:05.019014 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b9027501-932c-44e1-8454-32d1466f616e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:05.020019 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b9027501-932c-44e1-8454-32d1466f616e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:05.028657 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b9027501-932c-44e1-8454-32d1466f616e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:05.029228 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b9027501-932c-44e1-8454-32d1466f616e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:05.030031 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b9027501-932c-44e1-8454-32d1466f616e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:05.030474 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b9027501-932c-44e1-8454-32d1466f616e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:05.160742 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=4 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:25:05.189946 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b9027501-932c-44e1-8454-32d1466f616e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:05.196510 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b9027501-932c-44e1-8454-32d1466f616e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:05.198015 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b9027501-932c-44e1-8454-32d1466f616e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:05.199210 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b9027501-932c-44e1-8454-32d1466f616e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1724 microversion: 2.20 time: 0.185601 Jul 31 14:25:05.216405 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 155/317] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:05 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:25:05.435728 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-71bbcf94-416d-42fd-b936-16cef5e72594 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:05.436514 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-71bbcf94-416d-42fd-b936-16cef5e72594 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:05.443677 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-71bbcf94-416d-42fd-b936-16cef5e72594 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:05.444379 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-71bbcf94-416d-42fd-b936-16cef5e72594 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:05.445379 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-71bbcf94-416d-42fd-b936-16cef5e72594 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:05.445912 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-71bbcf94-416d-42fd-b936-16cef5e72594 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:05.608004 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-71bbcf94-416d-42fd-b936-16cef5e72594 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:05.616787 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-71bbcf94-416d-42fd-b936-16cef5e72594 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.184943 Jul 31 14:25:05.617575 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 156/318] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:05 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:05.784838 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-a1cd1a52-8865-4464-a1ed-e2735cbd91e7 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:05.785462 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-a1cd1a52-8865-4464-a1ed-e2735cbd91e7 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:05.798894 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a1cd1a52-8865-4464-a1ed-e2735cbd91e7 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:05.799386 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a1cd1a52-8865-4464-a1ed-e2735cbd91e7 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:05.803064 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a1cd1a52-8865-4464-a1ed-e2735cbd91e7 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:05.803530 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a1cd1a52-8865-4464-a1ed-e2735cbd91e7 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:05.808142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=100 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:25:05.947729 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a1cd1a52-8865-4464-a1ed-e2735cbd91e7 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:05.956685 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-a1cd1a52-8865-4464-a1ed-e2735cbd91e7 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1259 microversion: 2.1 time: 0.175893 Jul 31 14:25:05.957571 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 157/319] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:05 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:06.223185 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-a4edbc0a-d4ed-4bb3-90e3-a600deea76cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:06.224520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-a4edbc0a-d4ed-4bb3-90e3-a600deea76cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:06.231568 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a4edbc0a-d4ed-4bb3-90e3-a600deea76cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:06.232146 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a4edbc0a-d4ed-4bb3-90e3-a600deea76cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:06.232982 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a4edbc0a-d4ed-4bb3-90e3-a600deea76cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:06.233794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a4edbc0a-d4ed-4bb3-90e3-a600deea76cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:06.371352 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a4edbc0a-d4ed-4bb3-90e3-a600deea76cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:06.381013 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a4edbc0a-d4ed-4bb3-90e3-a600deea76cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:06.383070 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a4edbc0a-d4ed-4bb3-90e3-a600deea76cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:06.384566 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-a4edbc0a-d4ed-4bb3-90e3-a600deea76cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1724 microversion: 2.20 time: 0.165989 Jul 31 14:25:06.387466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 158/320] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:06 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:25:06.639053 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-f2b02182-938c-4e51-9916-323f22ff365e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:06.640370 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-f2b02182-938c-4e51-9916-323f22ff365e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:06.649685 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f2b02182-938c-4e51-9916-323f22ff365e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:06.650351 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f2b02182-938c-4e51-9916-323f22ff365e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:06.651675 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f2b02182-938c-4e51-9916-323f22ff365e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:06.652318 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f2b02182-938c-4e51-9916-323f22ff365e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:06.809232 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-f2b02182-938c-4e51-9916-323f22ff365e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:06.817333 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-f2b02182-938c-4e51-9916-323f22ff365e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.183150 Jul 31 14:25:06.818472 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 159/321] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:06 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:06.977947 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-36a5c7c4-4be4-470d-8bdc-ce28f802fbc2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:06.978814 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-36a5c7c4-4be4-470d-8bdc-ce28f802fbc2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:06.986084 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-36a5c7c4-4be4-470d-8bdc-ce28f802fbc2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:06.986813 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-36a5c7c4-4be4-470d-8bdc-ce28f802fbc2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:06.987866 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-36a5c7c4-4be4-470d-8bdc-ce28f802fbc2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:06.988522 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-36a5c7c4-4be4-470d-8bdc-ce28f802fbc2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:07.088715 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=22 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:25:07.142176 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-36a5c7c4-4be4-470d-8bdc-ce28f802fbc2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:07.150557 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-36a5c7c4-4be4-470d-8bdc-ce28f802fbc2 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1259 microversion: 2.1 time: 0.177034 Jul 31 14:25:07.151503 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 160/322] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:06 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:07.164153 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:25:07.409057 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-1eccf8c3-6675-4600-8e37-63e44110ca2e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:07.409784 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-1eccf8c3-6675-4600-8e37-63e44110ca2e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:07.417048 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1eccf8c3-6675-4600-8e37-63e44110ca2e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:07.417456 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1eccf8c3-6675-4600-8e37-63e44110ca2e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:07.418233 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1eccf8c3-6675-4600-8e37-63e44110ca2e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:07.418728 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1eccf8c3-6675-4600-8e37-63e44110ca2e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:07.557508 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-1eccf8c3-6675-4600-8e37-63e44110ca2e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:07.565378 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-1eccf8c3-6675-4600-8e37-63e44110ca2e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:07.566874 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-1eccf8c3-6675-4600-8e37-63e44110ca2e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:07.568872 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-1eccf8c3-6675-4600-8e37-63e44110ca2e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1724 microversion: 2.20 time: 0.163571 Jul 31 14:25:07.569429 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 161/323] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:07 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:07.839374 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-fb567d18-6fce-4f41-baa8-4527474d1cc9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:07.840013 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-fb567d18-6fce-4f41-baa8-4527474d1cc9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:07.846620 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fb567d18-6fce-4f41-baa8-4527474d1cc9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:07.846980 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fb567d18-6fce-4f41-baa8-4527474d1cc9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:07.847781 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fb567d18-6fce-4f41-baa8-4527474d1cc9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:07.848227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fb567d18-6fce-4f41-baa8-4527474d1cc9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:07.992022 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-fb567d18-6fce-4f41-baa8-4527474d1cc9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:08.001346 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-fb567d18-6fce-4f41-baa8-4527474d1cc9 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.166221 Jul 31 14:25:08.001987 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 162/324] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:07 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:08.171455 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-c1e1e5e1-acd8-41b9-b757-b4759b0a7e74 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:08.172268 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-c1e1e5e1-acd8-41b9-b757-b4759b0a7e74 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:08.179101 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c1e1e5e1-acd8-41b9-b757-b4759b0a7e74 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:08.179717 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c1e1e5e1-acd8-41b9-b757-b4759b0a7e74 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:08.180689 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c1e1e5e1-acd8-41b9-b757-b4759b0a7e74 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:08.180984 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c1e1e5e1-acd8-41b9-b757-b4759b0a7e74 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:08.257176 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:25:08.280277 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=6 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:25:08.337101 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c1e1e5e1-acd8-41b9-b757-b4759b0a7e74 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:08.344598 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-c1e1e5e1-acd8-41b9-b757-b4759b0a7e74 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1259 microversion: 2.1 time: 0.177083 Jul 31 14:25:08.345332 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 163/325] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:08 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:08.595329 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-a457fc5e-5350-4129-8c31-e7773c766788 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:08.596073 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-a457fc5e-5350-4129-8c31-e7773c766788 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:08.608130 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a457fc5e-5350-4129-8c31-e7773c766788 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:08.608576 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a457fc5e-5350-4129-8c31-e7773c766788 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:08.609378 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a457fc5e-5350-4129-8c31-e7773c766788 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:08.609816 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a457fc5e-5350-4129-8c31-e7773c766788 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:08.742950 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a457fc5e-5350-4129-8c31-e7773c766788 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:08.751979 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a457fc5e-5350-4129-8c31-e7773c766788 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:08.753712 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a457fc5e-5350-4129-8c31-e7773c766788 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:08.754943 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-a457fc5e-5350-4129-8c31-e7773c766788 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1724 microversion: 2.20 time: 0.163653 Jul 31 14:25:08.759667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 164/326] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:08 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:25:09.030209 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-907f1941-e124-4bd4-badf-c9702a500a6c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:09.031027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-907f1941-e124-4bd4-badf-c9702a500a6c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:09.038038 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-907f1941-e124-4bd4-badf-c9702a500a6c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:09.038490 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-907f1941-e124-4bd4-badf-c9702a500a6c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:09.039269 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-907f1941-e124-4bd4-badf-c9702a500a6c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:09.039740 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-907f1941-e124-4bd4-badf-c9702a500a6c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:09.182870 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.network.neutron [None req-e78b62d5-40b6-48f5-b474-bce822bdd2d9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] validate_networks() for [('cbc0073a-ae55-48a9-8514-9052086eccf8', None, None, None, None, None)] {{(pid=117780) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 14:25:09.237185 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-907f1941-e124-4bd4-badf-c9702a500a6c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:09.245800 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-907f1941-e124-4bd4-badf-c9702a500a6c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.219419 Jul 31 14:25:09.261748 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 165/327] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:09 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:09.375312 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-88996487-8981-4c8d-ab32-b3ae78cfcd13 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:09.376399 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-88996487-8981-4c8d-ab32-b3ae78cfcd13 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:09.383587 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-88996487-8981-4c8d-ab32-b3ae78cfcd13 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:09.384100 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-88996487-8981-4c8d-ab32-b3ae78cfcd13 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:09.384937 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-88996487-8981-4c8d-ab32-b3ae78cfcd13 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:09.385374 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-88996487-8981-4c8d-ab32-b3ae78cfcd13 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:09.556242 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-88996487-8981-4c8d-ab32-b3ae78cfcd13 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:09.563764 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-88996487-8981-4c8d-ab32-b3ae78cfcd13 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1259 microversion: 2.1 time: 0.193906 Jul 31 14:25:09.564361 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 166/328] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:09 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:09.656773 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-e78b62d5-40b6-48f5-b474-bce822bdd2d9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Flavor limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 14:25:09.657737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-e78b62d5-40b6-48f5-b474-bce822bdd2d9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Image limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 14:25:09.658448 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-e78b62d5-40b6-48f5-b474-bce822bdd2d9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Flavor pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 14:25:09.659164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-e78b62d5-40b6-48f5-b474-bce822bdd2d9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Image pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 14:25:09.659844 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-e78b62d5-40b6-48f5-b474-bce822bdd2d9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 14:25:09.672397 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e78b62d5-40b6-48f5-b474-bce822bdd2d9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:09.673145 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e78b62d5-40b6-48f5-b474-bce822bdd2d9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:09.674163 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e78b62d5-40b6-48f5-b474-bce822bdd2d9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:09.674673 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e78b62d5-40b6-48f5-b474-bce822bdd2d9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:09.691892 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-e78b62d5-40b6-48f5-b474-bce822bdd2d9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Getting quotas for project 9097fd66951e457ba46812ff17db7501. Resources: {'cores', 'ram', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:25:09.695973 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-e78b62d5-40b6-48f5-b474-bce822bdd2d9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Getting quotas for user d6e8399080a942f1b689fc8c6b42c717 and project 9097fd66951e457ba46812ff17db7501. Resources: {'cores', 'ram', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:25:09.709203 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e78b62d5-40b6-48f5-b474-bce822bdd2d9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Going to run 1 instances... {{(pid=117780) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 14:25:09.712364 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e78b62d5-40b6-48f5-b474-bce822bdd2d9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57bc051a-64d0-4317-aa93-a7a2aed39369',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 14:25:09.779543 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e78b62d5-40b6-48f5-b474-bce822bdd2d9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 12.634715 Jul 31 14:25:09.780730 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 163/329] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Jul 31 14:24:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 12637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 14:25:09.781872 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-5aa09342-a9c2-41e6-8cb3-dc13f12d424d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:09.782557 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-5aa09342-a9c2-41e6-8cb3-dc13f12d424d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:09.791783 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5aa09342-a9c2-41e6-8cb3-dc13f12d424d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:09.796234 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5e4b553a-e3d4-47c8-ba4c-fb00d6a22f42 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:09.796921 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5aa09342-a9c2-41e6-8cb3-dc13f12d424d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:09.797285 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-5e4b553a-e3d4-47c8-ba4c-fb00d6a22f42 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:09.797874 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5aa09342-a9c2-41e6-8cb3-dc13f12d424d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:09.798387 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5aa09342-a9c2-41e6-8cb3-dc13f12d424d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:09.869696 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-5e4b553a-e3d4-47c8-ba4c-fb00d6a22f42 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:09.877606 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-5e4b553a-e3d4-47c8-ba4c-fb00d6a22f42 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 200 len: 1241 microversion: 2.1 time: 0.085833 Jul 31 14:25:09.878549 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 164/330] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:09 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:09.984630 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-5aa09342-a9c2-41e6-8cb3-dc13f12d424d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:09.996033 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-5aa09342-a9c2-41e6-8cb3-dc13f12d424d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:09.997890 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-5aa09342-a9c2-41e6-8cb3-dc13f12d424d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:09.999126 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-5aa09342-a9c2-41e6-8cb3-dc13f12d424d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1724 microversion: 2.20 time: 0.222355 Jul 31 14:25:10.000092 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 167/331] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:09 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:10.268476 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1631b589-cca8-43f4-9c6d-7d1635ba85f3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:10.269085 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1631b589-cca8-43f4-9c6d-7d1635ba85f3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:10.276417 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1631b589-cca8-43f4-9c6d-7d1635ba85f3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:10.277690 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1631b589-cca8-43f4-9c6d-7d1635ba85f3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:10.279203 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1631b589-cca8-43f4-9c6d-7d1635ba85f3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:10.279670 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1631b589-cca8-43f4-9c6d-7d1635ba85f3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:10.423233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1631b589-cca8-43f4-9c6d-7d1635ba85f3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:10.432142 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1631b589-cca8-43f4-9c6d-7d1635ba85f3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.167506 Jul 31 14:25:10.432700 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 165/332] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:10 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:10.584827 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b0ff0dc4-6184-4a93-851f-8c0dbb7570ee tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:10.585430 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b0ff0dc4-6184-4a93-851f-8c0dbb7570ee tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:10.591591 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b0ff0dc4-6184-4a93-851f-8c0dbb7570ee tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:10.592032 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b0ff0dc4-6184-4a93-851f-8c0dbb7570ee tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:10.592792 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b0ff0dc4-6184-4a93-851f-8c0dbb7570ee tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:10.593289 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b0ff0dc4-6184-4a93-851f-8c0dbb7570ee tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:10.735994 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b0ff0dc4-6184-4a93-851f-8c0dbb7570ee tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:10.744519 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b0ff0dc4-6184-4a93-851f-8c0dbb7570ee tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1259 microversion: 2.1 time: 0.163489 Jul 31 14:25:10.745114 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 168/333] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:10 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:10.899038 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-34d7f681-6a4e-47da-b637-da6a6c809bcb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:10.899702 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-34d7f681-6a4e-47da-b637-da6a6c809bcb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:10.906033 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-34d7f681-6a4e-47da-b637-da6a6c809bcb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:10.907150 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-34d7f681-6a4e-47da-b637-da6a6c809bcb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:10.908311 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-34d7f681-6a4e-47da-b637-da6a6c809bcb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:10.908772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-34d7f681-6a4e-47da-b637-da6a6c809bcb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:11.026982 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-33a76da3-13ca-4304-9230-04779c997f03 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:11.027806 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-33a76da3-13ca-4304-9230-04779c997f03 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:11.035547 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-33a76da3-13ca-4304-9230-04779c997f03 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:11.036136 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-33a76da3-13ca-4304-9230-04779c997f03 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:11.037095 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-33a76da3-13ca-4304-9230-04779c997f03 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:11.038254 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-33a76da3-13ca-4304-9230-04779c997f03 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:11.194063 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-33a76da3-13ca-4304-9230-04779c997f03 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:11.202692 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-33a76da3-13ca-4304-9230-04779c997f03 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:11.204227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-33a76da3-13ca-4304-9230-04779c997f03 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:11.205389 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-33a76da3-13ca-4304-9230-04779c997f03 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1724 microversion: 2.20 time: 0.182514 Jul 31 14:25:11.205953 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 169/334] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:11 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:11.211508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-34d7f681-6a4e-47da-b637-da6a6c809bcb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:11.218994 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-34d7f681-6a4e-47da-b637-da6a6c809bcb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 200 len: 1293 microversion: 2.1 time: 0.323866 Jul 31 14:25:11.219572 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 166/335] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:10 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 1293 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:11.452526 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7108edee-4fb1-4baa-825d-ef13acefae24 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:11.453127 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7108edee-4fb1-4baa-825d-ef13acefae24 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:11.459034 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7108edee-4fb1-4baa-825d-ef13acefae24 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:11.459504 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7108edee-4fb1-4baa-825d-ef13acefae24 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:11.460809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7108edee-4fb1-4baa-825d-ef13acefae24 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:11.461245 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7108edee-4fb1-4baa-825d-ef13acefae24 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:11.590540 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7108edee-4fb1-4baa-825d-ef13acefae24 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:11.598556 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7108edee-4fb1-4baa-825d-ef13acefae24 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.150144 Jul 31 14:25:11.599140 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 170/336] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:11 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:11.766345 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3f259042-cc03-4b93-8523-d70038fc7fac tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:11.766887 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3f259042-cc03-4b93-8523-d70038fc7fac tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:11.774091 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3f259042-cc03-4b93-8523-d70038fc7fac tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:11.774530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3f259042-cc03-4b93-8523-d70038fc7fac tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:11.775281 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3f259042-cc03-4b93-8523-d70038fc7fac tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:11.775743 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3f259042-cc03-4b93-8523-d70038fc7fac tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:11.906846 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3f259042-cc03-4b93-8523-d70038fc7fac tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:11.915875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3f259042-cc03-4b93-8523-d70038fc7fac tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1259 microversion: 2.1 time: 0.153320 Jul 31 14:25:11.916447 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 167/337] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:11 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:12.234791 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7c0dfa83-41a0-4aea-a96b-a0b95724d49d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:12.238275 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7c0dfa83-41a0-4aea-a96b-a0b95724d49d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:12.240229 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9da2bba8-506a-458a-a4a0-fdaea3a6e957 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:12.240854 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9da2bba8-506a-458a-a4a0-fdaea3a6e957 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:12.248789 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7c0dfa83-41a0-4aea-a96b-a0b95724d49d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:12.249474 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7c0dfa83-41a0-4aea-a96b-a0b95724d49d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:12.250590 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7c0dfa83-41a0-4aea-a96b-a0b95724d49d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:12.252068 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7c0dfa83-41a0-4aea-a96b-a0b95724d49d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:12.253041 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9da2bba8-506a-458a-a4a0-fdaea3a6e957 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:12.253832 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9da2bba8-506a-458a-a4a0-fdaea3a6e957 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:12.254812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9da2bba8-506a-458a-a4a0-fdaea3a6e957 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:12.255241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9da2bba8-506a-458a-a4a0-fdaea3a6e957 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:12.330240 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9da2bba8-506a-458a-a4a0-fdaea3a6e957 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:12.339735 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9da2bba8-506a-458a-a4a0-fdaea3a6e957 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 200 len: 1311 microversion: 2.1 time: 0.103416 Jul 31 14:25:12.353720 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 168/338] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:12 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 1311 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:12.420013 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7c0dfa83-41a0-4aea-a96b-a0b95724d49d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:12.428522 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7c0dfa83-41a0-4aea-a96b-a0b95724d49d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:12.430047 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7c0dfa83-41a0-4aea-a96b-a0b95724d49d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:12.431217 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7c0dfa83-41a0-4aea-a96b-a0b95724d49d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1724 microversion: 2.20 time: 0.206519 Jul 31 14:25:12.431817 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 171/339] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:12 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:12.623150 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-826f4a46-0aae-4b78-aa82-ea6d584ff3b3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:12.624045 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-826f4a46-0aae-4b78-aa82-ea6d584ff3b3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:12.639301 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-826f4a46-0aae-4b78-aa82-ea6d584ff3b3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:12.640689 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-826f4a46-0aae-4b78-aa82-ea6d584ff3b3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:12.642021 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-826f4a46-0aae-4b78-aa82-ea6d584ff3b3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:12.642673 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-826f4a46-0aae-4b78-aa82-ea6d584ff3b3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:12.863196 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-826f4a46-0aae-4b78-aa82-ea6d584ff3b3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:12.883751 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-826f4a46-0aae-4b78-aa82-ea6d584ff3b3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1501 microversion: 2.1 time: 0.266423 Jul 31 14:25:12.884276 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 169/340] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:12 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1501 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:12.907188 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7e93a12f-3c4d-4a00-8e83-c750153fbdb1 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c87cf6b-018b-4bed-8de0-a52d5d76e917"}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:25:12.909656 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7e93a12f-3c4d-4a00-8e83-c750153fbdb1 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:12.917220 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7e93a12f-3c4d-4a00-8e83-c750153fbdb1 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:12.917613 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7e93a12f-3c4d-4a00-8e83-c750153fbdb1 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:12.918576 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7e93a12f-3c4d-4a00-8e83-c750153fbdb1 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:12.919177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7e93a12f-3c4d-4a00-8e83-c750153fbdb1 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:12.939677 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-117b89e6-d387-46eb-94d9-8debd56d8df1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:12.941748 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-117b89e6-d387-46eb-94d9-8debd56d8df1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:12.954732 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.wsgi [None req-7e93a12f-3c4d-4a00-8e83-c750153fbdb1 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] HTTP exception thrown: Cannot 'attach_volume' instance 712880e4-54c2-4ea2-b932-a8ff5efa0966 while it is in vm_state rescued Jul 31 14:25:12.956390 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-117b89e6-d387-46eb-94d9-8debd56d8df1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:12.956820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7e93a12f-3c4d-4a00-8e83-c750153fbdb1 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Request method failure captured: Jul 31 14:25:12.956820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: request: POST /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966/os-volume_attachments HTTP/1.1 Jul 31 14:25:12.956820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept: application/json Jul 31 14:25:12.956820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept-Encoding: identity Jul 31 14:25:12.956820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Connection: close Jul 31 14:25:12.956820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Length: 74 Jul 31 14:25:12.956820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Type: application/json Jul 31 14:25:12.956820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Host: 10.222.0.40 Jul 31 14:25:12.956820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Openstack-System-Scope: None Jul 31 14:25:12.956820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: User-Agent: python-urllib3/1.26.10 Jul 31 14:25:12.956820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Auth-Token: gAAAAABi5pBD72W1Rjv6at1WfVNUymNduY_N-nFbxGXJkrDc28rQU3JtMQkgCsFoz5JacBevK8YSVtt5PGEmj8VgqIeKUZCOYsB9PlAVGw4jymIy85OyVcpnTAbNXZcwZxntPYKfyuD8D6hHzBOe0TS_x7j6S_M-nQlq-6OQzOt_ElSF-AtfcFg Jul 31 14:25:12.956820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Id: None Jul 31 14:25:12.956820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Name: None Jul 31 14:25:12.956820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Identity-Status: Confirmed Jul 31 14:25:12.956820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Is-Admin-Project: True Jul 31 14:25:12.956820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Id: default Jul 31 14:25:12.956820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Name: Default Jul 31 14:25:12.956820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Id: 832629dd8594494ab41b6596b2d73076 Jul 31 14:25:12.956820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1831825154 Jul 31 14:25:12.956820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Role: reader,member Jul 31 14:25:12.956820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Roles: reader,member Jul 31 14:25:12.958520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/832629dd8594494ab41b6596b2d73076"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_832629dd8594494ab41b6596b2d73076", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/832629dd8594494ab41b6596b2d73076"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/832629dd8594494ab41b6596b2d73076"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:25:12.958520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1831825154 Jul 31 14:25:12.958520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Id: 832629dd8594494ab41b6596b2d73076 Jul 31 14:25:12.958520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1831825154 Jul 31 14:25:12.958520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User: tempest-ServerRescueNegativeTestJSON-1831825154-project Jul 31 14:25:12.958520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Id: default Jul 31 14:25:12.958520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Name: Default Jul 31 14:25:12.958520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Id: 10a4469c46f64feb819f3b19a0f4e89b Jul 31 14:25:12.958520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1831825154-project Jul 31 14:25:12.958520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Jul 31 14:25:12.958520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {"volumeAttachment": {"volumeId": "8c87cf6b-018b-4bed-8de0-a52d5d76e917"}} Jul 31 14:25:12.958520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: method: > Jul 31 14:25:12.959279 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: exception: Cannot 'attach_volume' instance 712880e4-54c2-4ea2-b932-a8ff5efa0966 while it is in vm_state rescued Jul 31 14:25:12.959279 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: action_args: {'server_id': '712880e4-54c2-4ea2-b932-a8ff5efa0966', 'body': {'volumeAttachment': {'volumeId': '8c87cf6b-018b-4bed-8de0-a52d5d76e917'}}} Jul 31 14:25:12.959279 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:25:12.959279 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:25:12.959279 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 31 14:25:12.959279 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 31 14:25:12.959279 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 14:25:12.959279 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 14:25:12.959279 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 31 14:25:12.959279 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 31 14:25:12.959279 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 712880e4-54c2-4ea2-b932-a8ff5efa0966 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 31 14:25:12.959279 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:25:12.959279 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:25:12.959279 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:25:12.959279 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:25:12.959279 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:25:12.959279 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:25:12.959279 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:25:12.959279 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:25:12.960466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:25:12.960466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:25:12.960466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 14:25:12.960466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 14:25:12.960466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 14:25:12.960466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 14:25:12.960466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 14:25:12.960466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 14:25:12.960466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 31 14:25:12.960466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 31 14:25:12.960466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 31 14:25:12.960466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 31 14:25:12.960466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 712880e4-54c2-4ea2-b932-a8ff5efa0966 while it is in vm_state rescued Jul 31 14:25:12.960466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:25:12.960466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:25:12.960466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:25:12.960466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:25:12.960466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:25:12.960466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:25:12.961533 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:25:12.961533 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:25:12.961533 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 712880e4-54c2-4ea2-b932-a8ff5efa0966 while it is in vm_state rescued Jul 31 14:25:12.961533 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:25:12.961533 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7e93a12f-3c4d-4a00-8e83-c750153fbdb1 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Returning 409 to user: Cannot 'attach_volume' instance 712880e4-54c2-4ea2-b932-a8ff5efa0966 while it is in vm_state rescued {{(pid=117781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:25:12.961533 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7e93a12f-3c4d-4a00-8e83-c750153fbdb1 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "POST /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.056387 Jul 31 14:25:12.964272 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-117b89e6-d387-46eb-94d9-8debd56d8df1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:12.964507 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 172/341] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Jul 31 14:25:12 2022] POST /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966/os-volume_attachments => generated 152 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 31 14:25:12.967843 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-117b89e6-d387-46eb-94d9-8debd56d8df1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:12.969079 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-117b89e6-d387-46eb-94d9-8debd56d8df1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:12.970356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-147a2589-5c42-4b08-87ef-3b77c52f910e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:25:12.970896 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-147a2589-5c42-4b08-87ef-3b77c52f910e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:12.983296 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-147a2589-5c42-4b08-87ef-3b77c52f910e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:12.984525 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-147a2589-5c42-4b08-87ef-3b77c52f910e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:12.984723 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-147a2589-5c42-4b08-87ef-3b77c52f910e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:12.985168 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-147a2589-5c42-4b08-87ef-3b77c52f910e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:13.068007 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=100 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:25:13.105110 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-147a2589-5c42-4b08-87ef-3b77c52f910e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "POST /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966/action" status: 202 len: 0 microversion: 2.1 time: 0.139276 Jul 31 14:25:13.109847 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 173/342] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Jul 31 14:25:12 2022] POST /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:25:13.118414 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-bc3e3b21-7158-4916-88cd-cd12cc251e88 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:13.119446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-bc3e3b21-7158-4916-88cd-cd12cc251e88 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:13.130509 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bc3e3b21-7158-4916-88cd-cd12cc251e88 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:13.130983 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bc3e3b21-7158-4916-88cd-cd12cc251e88 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:13.132462 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bc3e3b21-7158-4916-88cd-cd12cc251e88 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:13.133602 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bc3e3b21-7158-4916-88cd-cd12cc251e88 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:13.214130 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-117b89e6-d387-46eb-94d9-8debd56d8df1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:13.222102 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-117b89e6-d387-46eb-94d9-8debd56d8df1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1259 microversion: 2.1 time: 0.289582 Jul 31 14:25:13.222675 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 170/343] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:12 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1259 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:13.228210 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-86669061-7604-42db-97a0-2c1203be25bb req-e4737c25-17b5-486c-9c07-b7b325567334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92439dcd-76b3-44fb-882b-1b8f0dcb9d73", "name": "network-vif-plugged", "status": "completed", "tag": "e91303da-f1e0-49da-acae-3ce6750984f8"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:25:13.241111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-86669061-7604-42db-97a0-2c1203be25bb req-e4737c25-17b5-486c-9c07-b7b325567334 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:13.241561 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-86669061-7604-42db-97a0-2c1203be25bb req-e4737c25-17b5-486c-9c07-b7b325567334 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:13.253258 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-86669061-7604-42db-97a0-2c1203be25bb req-e4737c25-17b5-486c-9c07-b7b325567334 service nova] Creating event network-vif-plugged:e91303da-f1e0-49da-acae-3ce6750984f8 for instance 92439dcd-76b3-44fb-882b-1b8f0dcb9d73 on hv-cinder-84984 Jul 31 14:25:13.258851 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-86669061-7604-42db-97a0-2c1203be25bb req-e4737c25-17b5-486c-9c07-b7b325567334 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034797 Jul 31 14:25:13.259718 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 171/344] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:25:13.362154 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-34029f26-04a9-451b-b43d-400a8a5588e9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:13.363117 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-34029f26-04a9-451b-b43d-400a8a5588e9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:13.370850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-34029f26-04a9-451b-b43d-400a8a5588e9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:13.371695 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-34029f26-04a9-451b-b43d-400a8a5588e9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:13.372595 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-34029f26-04a9-451b-b43d-400a8a5588e9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:13.373064 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-34029f26-04a9-451b-b43d-400a8a5588e9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:13.424531 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-bc3e3b21-7158-4916-88cd-cd12cc251e88 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:13.435668 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-bc3e3b21-7158-4916-88cd-cd12cc251e88 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1509 microversion: 2.1 time: 0.322423 Jul 31 14:25:13.436934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 174/345] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:13 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1509 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:13.458312 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-2a04a236-62d2-4961-9d43-09eb506a7e4e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:13.459220 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-2a04a236-62d2-4961-9d43-09eb506a7e4e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:13.464973 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-34029f26-04a9-451b-b43d-400a8a5588e9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:13.473329 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2a04a236-62d2-4961-9d43-09eb506a7e4e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:13.473652 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-34029f26-04a9-451b-b43d-400a8a5588e9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 200 len: 1299 microversion: 2.1 time: 0.116328 Jul 31 14:25:13.474617 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2a04a236-62d2-4961-9d43-09eb506a7e4e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:13.476150 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2a04a236-62d2-4961-9d43-09eb506a7e4e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:13.476827 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2a04a236-62d2-4961-9d43-09eb506a7e4e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:13.487045 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 172/346] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:13 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 1299 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:13.954145 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-2a04a236-62d2-4961-9d43-09eb506a7e4e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:13.963676 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-2a04a236-62d2-4961-9d43-09eb506a7e4e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:13.965198 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-2a04a236-62d2-4961-9d43-09eb506a7e4e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:13.966399 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-2a04a236-62d2-4961-9d43-09eb506a7e4e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1724 microversion: 2.20 time: 0.516036 Jul 31 14:25:13.967200 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 175/347] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:13 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1724 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:14.244345 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-938f214f-5e39-49c6-9f19-c22fc3a0b21f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:14.245084 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-938f214f-5e39-49c6-9f19-c22fc3a0b21f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:14.251713 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-938f214f-5e39-49c6-9f19-c22fc3a0b21f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:14.252237 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-938f214f-5e39-49c6-9f19-c22fc3a0b21f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:14.253409 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-938f214f-5e39-49c6-9f19-c22fc3a0b21f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:14.254119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-938f214f-5e39-49c6-9f19-c22fc3a0b21f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:14.418898 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-938f214f-5e39-49c6-9f19-c22fc3a0b21f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:14.427617 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-938f214f-5e39-49c6-9f19-c22fc3a0b21f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1259 microversion: 2.1 time: 0.187273 Jul 31 14:25:14.443506 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 173/348] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:14 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1259 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:14.460420 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-0fadd068-21fe-4f18-89a9-27616c775e23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:14.461040 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-0fadd068-21fe-4f18-89a9-27616c775e23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:14.467039 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0fadd068-21fe-4f18-89a9-27616c775e23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:14.467527 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0fadd068-21fe-4f18-89a9-27616c775e23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:14.468403 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0fadd068-21fe-4f18-89a9-27616c775e23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:14.468949 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0fadd068-21fe-4f18-89a9-27616c775e23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:14.494317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f43cc706-d8c0-49f7-82da-7f6c6b64919d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:14.494938 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f43cc706-d8c0-49f7-82da-7f6c6b64919d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:14.502646 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f43cc706-d8c0-49f7-82da-7f6c6b64919d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:14.503100 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f43cc706-d8c0-49f7-82da-7f6c6b64919d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:14.503907 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f43cc706-d8c0-49f7-82da-7f6c6b64919d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:14.504346 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f43cc706-d8c0-49f7-82da-7f6c6b64919d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:14.670895 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f43cc706-d8c0-49f7-82da-7f6c6b64919d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:14.679898 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f43cc706-d8c0-49f7-82da-7f6c6b64919d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 200 len: 1367 microversion: 2.1 time: 0.189424 Jul 31 14:25:14.683955 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 174/349] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:14 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:14.795796 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-0fadd068-21fe-4f18-89a9-27616c775e23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:14.804260 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-0fadd068-21fe-4f18-89a9-27616c775e23 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1509 microversion: 2.1 time: 0.348493 Jul 31 14:25:14.815474 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 176/350] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:14 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1509 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:14.989536 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f4fc6589-8f59-49e6-87f2-7e574ce75e1d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:14.990495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f4fc6589-8f59-49e6-87f2-7e574ce75e1d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:14.997968 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f4fc6589-8f59-49e6-87f2-7e574ce75e1d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:14.998768 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f4fc6589-8f59-49e6-87f2-7e574ce75e1d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:14.999582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f4fc6589-8f59-49e6-87f2-7e574ce75e1d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:15.000282 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f4fc6589-8f59-49e6-87f2-7e574ce75e1d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:15.175131 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f4fc6589-8f59-49e6-87f2-7e574ce75e1d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:15.186438 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f4fc6589-8f59-49e6-87f2-7e574ce75e1d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:15.188253 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f4fc6589-8f59-49e6-87f2-7e574ce75e1d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:15.190906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f4fc6589-8f59-49e6-87f2-7e574ce75e1d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1745 microversion: 2.20 time: 0.204570 Jul 31 14:25:15.192000 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 175/351] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:14 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1745 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:15.449614 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-48be5445-0227-4a80-880c-887fe0706cea tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:15.450736 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-48be5445-0227-4a80-880c-887fe0706cea tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:15.458757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-48be5445-0227-4a80-880c-887fe0706cea tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:15.459983 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-48be5445-0227-4a80-880c-887fe0706cea tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:15.461017 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-48be5445-0227-4a80-880c-887fe0706cea tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:15.462092 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-48be5445-0227-4a80-880c-887fe0706cea tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:15.590364 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-9e2ce508-86cf-45a5-9cd2-8b1983fc426c req-98aa966d-46a3-48d0-8a0d-3bf5c6e7c5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed5b3d28-2f47-4309-a909-0210c782aad3", "tag": "78bad9ba-f468-4e03-9786-7c27cd0658de"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:25:15.600345 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-9e2ce508-86cf-45a5-9cd2-8b1983fc426c req-98aa966d-46a3-48d0-8a0d-3bf5c6e7c5a6 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:15.600782 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-9e2ce508-86cf-45a5-9cd2-8b1983fc426c req-98aa966d-46a3-48d0-8a0d-3bf5c6e7c5a6 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:15.611804 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-9e2ce508-86cf-45a5-9cd2-8b1983fc426c req-98aa966d-46a3-48d0-8a0d-3bf5c6e7c5a6 service nova] Creating event network-changed:78bad9ba-f468-4e03-9786-7c27cd0658de for instance ed5b3d28-2f47-4309-a909-0210c782aad3 on hv-cinder-84984 Jul 31 14:25:15.617730 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-9e2ce508-86cf-45a5-9cd2-8b1983fc426c req-98aa966d-46a3-48d0-8a0d-3bf5c6e7c5a6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030982 Jul 31 14:25:15.618989 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 176/352] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:25:15.689358 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-48be5445-0227-4a80-880c-887fe0706cea tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:15.697644 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-48be5445-0227-4a80-880c-887fe0706cea tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1441 microversion: 2.1 time: 0.252179 Jul 31 14:25:15.711447 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 177/353] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:15 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1441 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:15.711987 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8fdab37c-7f76-4f60-bb48-56d7d72e3dd5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:15.711987 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8fdab37c-7f76-4f60-bb48-56d7d72e3dd5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:15.711987 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8fdab37c-7f76-4f60-bb48-56d7d72e3dd5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:15.711987 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8fdab37c-7f76-4f60-bb48-56d7d72e3dd5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:15.712619 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8fdab37c-7f76-4f60-bb48-56d7d72e3dd5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:15.712619 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8fdab37c-7f76-4f60-bb48-56d7d72e3dd5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:15.720730 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-138e92e4-5e51-40e7-9d38-16b4543d5d6f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:15.721348 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-138e92e4-5e51-40e7-9d38-16b4543d5d6f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:15.723222 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:25:15.729647 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-138e92e4-5e51-40e7-9d38-16b4543d5d6f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:15.730538 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-138e92e4-5e51-40e7-9d38-16b4543d5d6f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:15.732423 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-138e92e4-5e51-40e7-9d38-16b4543d5d6f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:15.732873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-138e92e4-5e51-40e7-9d38-16b4543d5d6f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:15.862670 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8fdab37c-7f76-4f60-bb48-56d7d72e3dd5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:15.872957 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8fdab37c-7f76-4f60-bb48-56d7d72e3dd5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 200 len: 1367 microversion: 2.1 time: 0.175862 Jul 31 14:25:15.884780 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-138e92e4-5e51-40e7-9d38-16b4543d5d6f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:15.892162 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 177/354] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:15 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:15.895616 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-138e92e4-5e51-40e7-9d38-16b4543d5d6f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1441 microversion: 2.1 time: 0.178408 Jul 31 14:25:15.896604 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 178/355] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:15 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1441 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:15.910587 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-13b20639-108d-4e84-b7e3-88c4693d5123 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:15.911291 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-13b20639-108d-4e84-b7e3-88c4693d5123 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:15.923745 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-13b20639-108d-4e84-b7e3-88c4693d5123 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:15.924088 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-13b20639-108d-4e84-b7e3-88c4693d5123 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:15.924870 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-13b20639-108d-4e84-b7e3-88c4693d5123 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:15.925307 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-13b20639-108d-4e84-b7e3-88c4693d5123 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:16.067782 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-13b20639-108d-4e84-b7e3-88c4693d5123 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:16.076576 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-13b20639-108d-4e84-b7e3-88c4693d5123 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1509 microversion: 2.1 time: 0.183063 Jul 31 14:25:16.077135 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 178/356] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:15 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1509 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:16.215877 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-12281f58-d9c2-485a-8807-795e49dca934 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:16.216849 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-12281f58-d9c2-485a-8807-795e49dca934 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:16.222749 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-12281f58-d9c2-485a-8807-795e49dca934 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:16.223190 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-12281f58-d9c2-485a-8807-795e49dca934 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:16.223979 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-12281f58-d9c2-485a-8807-795e49dca934 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:16.224412 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-12281f58-d9c2-485a-8807-795e49dca934 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:16.450429 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-12281f58-d9c2-485a-8807-795e49dca934 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:16.459021 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-12281f58-d9c2-485a-8807-795e49dca934 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:16.461416 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-12281f58-d9c2-485a-8807-795e49dca934 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:16.463811 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-12281f58-d9c2-485a-8807-795e49dca934 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1745 microversion: 2.20 time: 0.252573 Jul 31 14:25:16.464634 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 179/357] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:16 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1745 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:25:16.896666 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-151382ab-4220-4b41-b0c6-57a22ac4799a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:16.897422 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-151382ab-4220-4b41-b0c6-57a22ac4799a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:16.903908 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-151382ab-4220-4b41-b0c6-57a22ac4799a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:16.904355 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-151382ab-4220-4b41-b0c6-57a22ac4799a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:16.905128 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-151382ab-4220-4b41-b0c6-57a22ac4799a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:16.905577 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-151382ab-4220-4b41-b0c6-57a22ac4799a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:17.042424 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-151382ab-4220-4b41-b0c6-57a22ac4799a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:17.049833 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-151382ab-4220-4b41-b0c6-57a22ac4799a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 200 len: 1367 microversion: 2.1 time: 0.157420 Jul 31 14:25:17.050395 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 179/358] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:16 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:17.097687 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-dcb6ba00-59c7-4d03-99e3-1584e6a08458 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:17.098301 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-dcb6ba00-59c7-4d03-99e3-1584e6a08458 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:17.105298 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dcb6ba00-59c7-4d03-99e3-1584e6a08458 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:17.105757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dcb6ba00-59c7-4d03-99e3-1584e6a08458 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:17.106526 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dcb6ba00-59c7-4d03-99e3-1584e6a08458 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:17.106964 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dcb6ba00-59c7-4d03-99e3-1584e6a08458 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:17.318031 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-dcb6ba00-59c7-4d03-99e3-1584e6a08458 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:17.325725 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-dcb6ba00-59c7-4d03-99e3-1584e6a08458 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1509 microversion: 2.1 time: 0.231754 Jul 31 14:25:17.326303 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 180/359] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:17 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1509 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:17.488145 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f388f863-9baf-41c9-a567-55fb47dd188b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:17.488658 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f388f863-9baf-41c9-a567-55fb47dd188b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:17.495232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f388f863-9baf-41c9-a567-55fb47dd188b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:17.495709 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f388f863-9baf-41c9-a567-55fb47dd188b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:17.496755 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f388f863-9baf-41c9-a567-55fb47dd188b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:17.497195 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f388f863-9baf-41c9-a567-55fb47dd188b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:17.625734 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f388f863-9baf-41c9-a567-55fb47dd188b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:17.634419 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f388f863-9baf-41c9-a567-55fb47dd188b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:17.635981 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f388f863-9baf-41c9-a567-55fb47dd188b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:17.637140 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f388f863-9baf-41c9-a567-55fb47dd188b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1745 microversion: 2.20 time: 0.153038 Jul 31 14:25:17.637699 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 180/360] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:17 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:18.072008 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-d0fff322-d932-48ea-9edd-29aacc6a17f4 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:18.072629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-d0fff322-d932-48ea-9edd-29aacc6a17f4 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:18.078908 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d0fff322-d932-48ea-9edd-29aacc6a17f4 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:18.079351 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d0fff322-d932-48ea-9edd-29aacc6a17f4 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:18.080327 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d0fff322-d932-48ea-9edd-29aacc6a17f4 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:18.080757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d0fff322-d932-48ea-9edd-29aacc6a17f4 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:18.346179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-89f183e4-961e-4399-8fe2-476a99d53685 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:18.346788 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-89f183e4-961e-4399-8fe2-476a99d53685 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:18.355156 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-89f183e4-961e-4399-8fe2-476a99d53685 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:18.355686 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-89f183e4-961e-4399-8fe2-476a99d53685 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:18.356459 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-89f183e4-961e-4399-8fe2-476a99d53685 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:18.356892 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-89f183e4-961e-4399-8fe2-476a99d53685 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:18.458300 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-d0fff322-d932-48ea-9edd-29aacc6a17f4 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:18.470253 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-d0fff322-d932-48ea-9edd-29aacc6a17f4 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 200 len: 1367 microversion: 2.1 time: 0.402674 Jul 31 14:25:18.483465 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 181/361] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:18 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 1367 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:18.492482 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-f3153305-a249-42e3-ba96-e2a4209c8f50 req-0514094b-79b7-484d-9ed0-0063d07875c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92439dcd-76b3-44fb-882b-1b8f0dcb9d73", "tag": "e91303da-f1e0-49da-acae-3ce6750984f8"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:25:18.509026 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-f3153305-a249-42e3-ba96-e2a4209c8f50 req-0514094b-79b7-484d-9ed0-0063d07875c9 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:18.509486 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-f3153305-a249-42e3-ba96-e2a4209c8f50 req-0514094b-79b7-484d-9ed0-0063d07875c9 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:18.524811 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-f3153305-a249-42e3-ba96-e2a4209c8f50 req-0514094b-79b7-484d-9ed0-0063d07875c9 service nova] Creating event network-changed:e91303da-f1e0-49da-acae-3ce6750984f8 for instance 92439dcd-76b3-44fb-882b-1b8f0dcb9d73 on hv-cinder-84984 Jul 31 14:25:18.532943 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-f3153305-a249-42e3-ba96-e2a4209c8f50 req-0514094b-79b7-484d-9ed0-0063d07875c9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057469 Jul 31 14:25:18.533865 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 182/362] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:25:18.556043 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-89f183e4-961e-4399-8fe2-476a99d53685 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:18.563992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-89f183e4-961e-4399-8fe2-476a99d53685 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1509 microversion: 2.1 time: 0.221561 Jul 31 14:25:18.564664 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 181/363] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:18 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1509 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:18.646703 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-589ff756-660b-4dc2-b2ef-6a865d3999bf req-5c14d6b1-bfda-4291-937c-1c4154138a89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0810b36-49ee-482b-9e65-f587148b2a81", "name": "network-vif-plugged", "status": "completed", "tag": "24bdbc3b-fa2f-407d-8ddb-f37abeee2dba"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:25:18.657782 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-589ff756-660b-4dc2-b2ef-6a865d3999bf req-5c14d6b1-bfda-4291-937c-1c4154138a89 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:18.658215 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-589ff756-660b-4dc2-b2ef-6a865d3999bf req-5c14d6b1-bfda-4291-937c-1c4154138a89 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:18.660624 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8e6ee260-9edd-4f16-9870-5ca9eea4eee9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:18.662277 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8e6ee260-9edd-4f16-9870-5ca9eea4eee9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:18.668962 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8e6ee260-9edd-4f16-9870-5ca9eea4eee9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:18.670359 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8e6ee260-9edd-4f16-9870-5ca9eea4eee9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:18.671509 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-589ff756-660b-4dc2-b2ef-6a865d3999bf req-5c14d6b1-bfda-4291-937c-1c4154138a89 service nova] Creating event network-vif-plugged:24bdbc3b-fa2f-407d-8ddb-f37abeee2dba for instance d0810b36-49ee-482b-9e65-f587148b2a81 on hv-cinder-84984 Jul 31 14:25:18.671933 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8e6ee260-9edd-4f16-9870-5ca9eea4eee9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:18.672582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8e6ee260-9edd-4f16-9870-5ca9eea4eee9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:18.677832 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-589ff756-660b-4dc2-b2ef-6a865d3999bf req-5c14d6b1-bfda-4291-937c-1c4154138a89 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035608 Jul 31 14:25:18.678598 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 183/364] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:25:18.694513 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=100 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:25:18.823368 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8e6ee260-9edd-4f16-9870-5ca9eea4eee9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:18.831782 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8e6ee260-9edd-4f16-9870-5ca9eea4eee9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:18.833438 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8e6ee260-9edd-4f16-9870-5ca9eea4eee9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:18.835648 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8e6ee260-9edd-4f16-9870-5ca9eea4eee9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1745 microversion: 2.20 time: 0.178154 Jul 31 14:25:18.836278 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 182/365] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:18 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:25:19.496336 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-00470ddb-02d5-45d4-9a39-98e0f13398f0 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:19.497126 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-00470ddb-02d5-45d4-9a39-98e0f13398f0 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:19.505003 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-00470ddb-02d5-45d4-9a39-98e0f13398f0 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:19.505769 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-00470ddb-02d5-45d4-9a39-98e0f13398f0 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:19.507022 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-00470ddb-02d5-45d4-9a39-98e0f13398f0 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:19.507831 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-00470ddb-02d5-45d4-9a39-98e0f13398f0 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:19.585642 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-de785585-d20f-4fc7-b687-68881842fa4b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:19.586167 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-de785585-d20f-4fc7-b687-68881842fa4b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:19.593410 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-de785585-d20f-4fc7-b687-68881842fa4b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:19.593926 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-de785585-d20f-4fc7-b687-68881842fa4b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:19.594801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-de785585-d20f-4fc7-b687-68881842fa4b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:19.595481 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-de785585-d20f-4fc7-b687-68881842fa4b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:19.645778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-00470ddb-02d5-45d4-9a39-98e0f13398f0 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:19.653917 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-00470ddb-02d5-45d4-9a39-98e0f13398f0 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 200 len: 1367 microversion: 2.1 time: 0.163360 Jul 31 14:25:19.654485 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 184/366] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:19 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:19.682858 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:25:19.744496 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-de785585-d20f-4fc7-b687-68881842fa4b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:19.752282 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-de785585-d20f-4fc7-b687-68881842fa4b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1509 microversion: 2.1 time: 0.170739 Jul 31 14:25:19.752844 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 183/367] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:19 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:19.858038 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-e151e72d-6edf-4fe9-a266-9797538b752b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:19.858640 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-e151e72d-6edf-4fe9-a266-9797538b752b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:19.866214 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e151e72d-6edf-4fe9-a266-9797538b752b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:19.866730 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e151e72d-6edf-4fe9-a266-9797538b752b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:19.867598 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e151e72d-6edf-4fe9-a266-9797538b752b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:19.868061 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e151e72d-6edf-4fe9-a266-9797538b752b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:20.015657 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e151e72d-6edf-4fe9-a266-9797538b752b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:20.024587 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e151e72d-6edf-4fe9-a266-9797538b752b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:20.026320 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e151e72d-6edf-4fe9-a266-9797538b752b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:20.027504 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-e151e72d-6edf-4fe9-a266-9797538b752b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1745 microversion: 2.20 time: 0.173420 Jul 31 14:25:20.028110 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 185/368] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:19 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:20.674979 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3431c420-7f1f-4d89-a455-5560f52e8e03 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:20.675781 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3431c420-7f1f-4d89-a455-5560f52e8e03 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:20.679204 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=8 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:25:20.683823 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3431c420-7f1f-4d89-a455-5560f52e8e03 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:20.684271 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3431c420-7f1f-4d89-a455-5560f52e8e03 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:20.685031 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3431c420-7f1f-4d89-a455-5560f52e8e03 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:20.685462 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3431c420-7f1f-4d89-a455-5560f52e8e03 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:20.773441 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-838b9a4d-1c1f-48f7-af87-e483dc56120f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:20.774146 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-838b9a4d-1c1f-48f7-af87-e483dc56120f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:20.780707 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-838b9a4d-1c1f-48f7-af87-e483dc56120f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:20.781235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-838b9a4d-1c1f-48f7-af87-e483dc56120f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:20.782107 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-838b9a4d-1c1f-48f7-af87-e483dc56120f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:20.782622 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-838b9a4d-1c1f-48f7-af87-e483dc56120f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:20.819716 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3431c420-7f1f-4d89-a455-5560f52e8e03 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:20.827997 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3431c420-7f1f-4d89-a455-5560f52e8e03 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 200 len: 1367 microversion: 2.1 time: 0.156814 Jul 31 14:25:20.828578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 184/369] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:20 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:20.980479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-838b9a4d-1c1f-48f7-af87-e483dc56120f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:20.987923 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-838b9a4d-1c1f-48f7-af87-e483dc56120f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1509 microversion: 2.1 time: 0.218360 Jul 31 14:25:20.988484 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 186/370] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:20 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:21.052749 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c34c1710-fb14-4a27-8cb4-28a24871e487 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:21.054023 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c34c1710-fb14-4a27-8cb4-28a24871e487 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:21.060062 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c34c1710-fb14-4a27-8cb4-28a24871e487 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:21.060500 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c34c1710-fb14-4a27-8cb4-28a24871e487 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:21.061252 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c34c1710-fb14-4a27-8cb4-28a24871e487 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:21.061685 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c34c1710-fb14-4a27-8cb4-28a24871e487 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:21.190469 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c34c1710-fb14-4a27-8cb4-28a24871e487 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:21.198485 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c34c1710-fb14-4a27-8cb4-28a24871e487 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:21.200121 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c34c1710-fb14-4a27-8cb4-28a24871e487 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:21.201586 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c34c1710-fb14-4a27-8cb4-28a24871e487 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1745 microversion: 2.20 time: 0.152855 Jul 31 14:25:21.202220 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 185/371] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:21 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:21.849193 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-47dbbeb2-e1c3-436c-a1c3-5900ab73f6d2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:21.850801 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-47dbbeb2-e1c3-436c-a1c3-5900ab73f6d2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:21.858262 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-47dbbeb2-e1c3-436c-a1c3-5900ab73f6d2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:21.858873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-47dbbeb2-e1c3-436c-a1c3-5900ab73f6d2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:21.859818 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-47dbbeb2-e1c3-436c-a1c3-5900ab73f6d2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:21.860424 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-47dbbeb2-e1c3-436c-a1c3-5900ab73f6d2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:22.011687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-140a80f3-d698-4602-b352-6f305b6589da tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:22.012344 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-140a80f3-d698-4602-b352-6f305b6589da tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:22.019621 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-140a80f3-d698-4602-b352-6f305b6589da tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:22.020074 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-140a80f3-d698-4602-b352-6f305b6589da tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:22.021447 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-140a80f3-d698-4602-b352-6f305b6589da tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:22.021953 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-140a80f3-d698-4602-b352-6f305b6589da tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:22.027573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-47dbbeb2-e1c3-436c-a1c3-5900ab73f6d2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:22.035792 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-47dbbeb2-e1c3-436c-a1c3-5900ab73f6d2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 200 len: 1367 microversion: 2.1 time: 0.190866 Jul 31 14:25:22.036949 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 187/372] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:21 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:22.166304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-140a80f3-d698-4602-b352-6f305b6589da tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:22.174012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-140a80f3-d698-4602-b352-6f305b6589da tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1515 microversion: 2.1 time: 0.167759 Jul 31 14:25:22.174655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 186/373] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:22 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:22.225046 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-efc82571-82e5-438c-bf5b-dff1dada69bf tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:22.225872 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-efc82571-82e5-438c-bf5b-dff1dada69bf tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:22.231949 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-efc82571-82e5-438c-bf5b-dff1dada69bf tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:22.232397 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-efc82571-82e5-438c-bf5b-dff1dada69bf tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:22.233169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-efc82571-82e5-438c-bf5b-dff1dada69bf tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:22.233633 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-efc82571-82e5-438c-bf5b-dff1dada69bf tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:22.408988 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-efc82571-82e5-438c-bf5b-dff1dada69bf tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:22.423389 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-efc82571-82e5-438c-bf5b-dff1dada69bf tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:22.425202 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-efc82571-82e5-438c-bf5b-dff1dada69bf tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:22.426867 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-efc82571-82e5-438c-bf5b-dff1dada69bf tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1740 microversion: 2.20 time: 0.205353 Jul 31 14:25:22.431881 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 188/374] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:22 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:23.057910 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a04e0fad-620e-48b2-8e85-883b569f891a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:23.058609 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a04e0fad-620e-48b2-8e85-883b569f891a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:23.064956 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a04e0fad-620e-48b2-8e85-883b569f891a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:23.065522 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a04e0fad-620e-48b2-8e85-883b569f891a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:23.066365 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a04e0fad-620e-48b2-8e85-883b569f891a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:23.066930 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a04e0fad-620e-48b2-8e85-883b569f891a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:23.201187 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a04e0fad-620e-48b2-8e85-883b569f891a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:23.208655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a04e0fad-620e-48b2-8e85-883b569f891a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 200 len: 1367 microversion: 2.1 time: 0.155582 Jul 31 14:25:23.209172 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 187/375] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:23 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:23.452445 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-e2de0c4e-bff9-488a-b6b5-1ead2c4758af tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:23.453052 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-e2de0c4e-bff9-488a-b6b5-1ead2c4758af tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:23.460154 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e2de0c4e-bff9-488a-b6b5-1ead2c4758af tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:23.460604 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e2de0c4e-bff9-488a-b6b5-1ead2c4758af tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:23.461451 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e2de0c4e-bff9-488a-b6b5-1ead2c4758af tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:23.461979 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e2de0c4e-bff9-488a-b6b5-1ead2c4758af tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:23.591118 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e2de0c4e-bff9-488a-b6b5-1ead2c4758af tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:23.599083 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e2de0c4e-bff9-488a-b6b5-1ead2c4758af tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:23.601300 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e2de0c4e-bff9-488a-b6b5-1ead2c4758af tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:23.602455 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-e2de0c4e-bff9-488a-b6b5-1ead2c4758af tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1740 microversion: 2.20 time: 0.154156 Jul 31 14:25:23.603023 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 189/376] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:23 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:24.229059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-72d21587-fac5-4697-acb0-3d49b16e2fc1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:24.229656 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-72d21587-fac5-4697-acb0-3d49b16e2fc1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:24.236197 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-72d21587-fac5-4697-acb0-3d49b16e2fc1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:24.236634 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-72d21587-fac5-4697-acb0-3d49b16e2fc1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:24.237383 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-72d21587-fac5-4697-acb0-3d49b16e2fc1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:24.237808 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-72d21587-fac5-4697-acb0-3d49b16e2fc1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:24.363871 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-72d21587-fac5-4697-acb0-3d49b16e2fc1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:24.371640 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-72d21587-fac5-4697-acb0-3d49b16e2fc1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 200 len: 1367 microversion: 2.1 time: 0.146397 Jul 31 14:25:24.372197 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 188/377] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:24 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:24.627555 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-d8f29f1e-c8a8-40d1-a7e8-61b323279be0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:24.628169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-d8f29f1e-c8a8-40d1-a7e8-61b323279be0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:24.634811 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d8f29f1e-c8a8-40d1-a7e8-61b323279be0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:24.635394 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d8f29f1e-c8a8-40d1-a7e8-61b323279be0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:24.636184 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d8f29f1e-c8a8-40d1-a7e8-61b323279be0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:24.636631 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d8f29f1e-c8a8-40d1-a7e8-61b323279be0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:24.765545 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-d8f29f1e-c8a8-40d1-a7e8-61b323279be0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:24.774416 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-d8f29f1e-c8a8-40d1-a7e8-61b323279be0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:24.775945 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-d8f29f1e-c8a8-40d1-a7e8-61b323279be0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:24.777102 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-d8f29f1e-c8a8-40d1-a7e8-61b323279be0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1740 microversion: 2.20 time: 0.153505 Jul 31 14:25:24.777665 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 190/378] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:24 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:25.391939 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9264a1db-38b3-456a-84c0-3b31ab815a22 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:25.392540 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9264a1db-38b3-456a-84c0-3b31ab815a22 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:25.399673 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9264a1db-38b3-456a-84c0-3b31ab815a22 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:25.400279 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9264a1db-38b3-456a-84c0-3b31ab815a22 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:25.401176 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9264a1db-38b3-456a-84c0-3b31ab815a22 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:25.401785 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9264a1db-38b3-456a-84c0-3b31ab815a22 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:25.536602 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9264a1db-38b3-456a-84c0-3b31ab815a22 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:25.544384 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9264a1db-38b3-456a-84c0-3b31ab815a22 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 200 len: 1367 microversion: 2.1 time: 0.156181 Jul 31 14:25:25.545039 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 189/379] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:25 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:25.699723 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-3858a75a-1230-41f4-bbea-2bbd736f8166 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Action: 'create', calling method: .version_select at 0x7f87e9b69820>, body: {"keypair": {"name": "tempest-keypair-1769865524", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIi0wg3yJzNB+I084+tblNgrek0c6dkon0FaiPSvMjTKeE7rBrRgS4q1+Cokn/Xv6Y3WzMOReC8y3v3sWIEF18xWYgE3+Y2s5Jas6nhqxtzJGqvEOLnbCRdALfYgxmF+w=="}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:25:25.715866 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-3858a75a-1230-41f4-bbea-2bbd736f8166 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Getting quotas for project 832629dd8594494ab41b6596b2d73076. Resources: {'key_pairs'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:25:25.720052 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-3858a75a-1230-41f4-bbea-2bbd736f8166 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Getting quotas for user 10a4469c46f64feb819f3b19a0f4e89b and project 832629dd8594494ab41b6596b2d73076. Resources: {'key_pairs'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:25:25.743197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-3858a75a-1230-41f4-bbea-2bbd736f8166 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047193 Jul 31 14:25:25.744180 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 191/380] 10.222.0.40 () {60 vars in 1159 bytes} [Sun Jul 31 14:25:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:25:25.803986 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c23c2ff5-5945-4e95-8051-bb9099ec39e6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:25.804644 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c23c2ff5-5945-4e95-8051-bb9099ec39e6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:25.811196 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c23c2ff5-5945-4e95-8051-bb9099ec39e6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:25.812843 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c23c2ff5-5945-4e95-8051-bb9099ec39e6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:25.813610 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c23c2ff5-5945-4e95-8051-bb9099ec39e6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:25.814197 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c23c2ff5-5945-4e95-8051-bb9099ec39e6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:26.036762 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c23c2ff5-5945-4e95-8051-bb9099ec39e6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:26.059771 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c23c2ff5-5945-4e95-8051-bb9099ec39e6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:26.062086 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c23c2ff5-5945-4e95-8051-bb9099ec39e6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:26.064897 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c23c2ff5-5945-4e95-8051-bb9099ec39e6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1740 microversion: 2.20 time: 0.265676 Jul 31 14:25:26.065966 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 190/381] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:25 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1740 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:26.343541 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-19caf45b-a206-4a32-9bff-dfbafdb33195 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1352433872", "imageRef": "57bc051a-64d0-4317-aa93-a7a2aed39369", "flavorRef": "452"}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:25:26.437782 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.network.neutron [None req-19caf45b-a206-4a32-9bff-dfbafdb33195 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] validate_networks() for None {{(pid=117781) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 14:25:26.565504 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-21644b11-5d15-4d70-a325-24ad0faf4056 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:26.567033 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-21644b11-5d15-4d70-a325-24ad0faf4056 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:26.577444 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-21644b11-5d15-4d70-a325-24ad0faf4056 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:26.578073 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-21644b11-5d15-4d70-a325-24ad0faf4056 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:26.579015 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-21644b11-5d15-4d70-a325-24ad0faf4056 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:26.579640 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-21644b11-5d15-4d70-a325-24ad0faf4056 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:26.853672 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-19caf45b-a206-4a32-9bff-dfbafdb33195 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Flavor limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 14:25:26.854151 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-19caf45b-a206-4a32-9bff-dfbafdb33195 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Image limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 14:25:26.854801 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-19caf45b-a206-4a32-9bff-dfbafdb33195 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Flavor pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 14:25:26.858478 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-19caf45b-a206-4a32-9bff-dfbafdb33195 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Image pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 14:25:26.859970 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-19caf45b-a206-4a32-9bff-dfbafdb33195 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 14:25:26.871806 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-19caf45b-a206-4a32-9bff-dfbafdb33195 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:26.872611 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-19caf45b-a206-4a32-9bff-dfbafdb33195 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:26.874120 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-19caf45b-a206-4a32-9bff-dfbafdb33195 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:26.875272 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-19caf45b-a206-4a32-9bff-dfbafdb33195 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:26.887072 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:25:26.894071 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-21644b11-5d15-4d70-a325-24ad0faf4056 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:26.903681 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-19caf45b-a206-4a32-9bff-dfbafdb33195 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Getting quotas for project b0ad86716ddf412f91a1128ba7159585. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:25:26.908411 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-21644b11-5d15-4d70-a325-24ad0faf4056 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 200 len: 1367 microversion: 2.1 time: 0.346787 Jul 31 14:25:26.909987 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-19caf45b-a206-4a32-9bff-dfbafdb33195 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Getting quotas for user b6d1952d79174b6596f829cd85ca690b and project b0ad86716ddf412f91a1128ba7159585. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:25:26.922556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 191/382] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:26 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:26.928085 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-19caf45b-a206-4a32-9bff-dfbafdb33195 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Going to run 1 instances... {{(pid=117781) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 14:25:26.928856 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-99a19417-ad96-49c4-bda4-551381827f3f req-561924ea-d9be-4d0d-a7cc-5a4ae5ac7ccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5b3d28-2f47-4309-a909-0210c782aad3", "name": "network-vif-plugged", "status": "completed", "tag": "78bad9ba-f468-4e03-9786-7c27cd0658de"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:25:26.930859 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-19caf45b-a206-4a32-9bff-dfbafdb33195 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57bc051a-64d0-4317-aa93-a7a2aed39369',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117781) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 14:25:26.940580 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-99a19417-ad96-49c4-bda4-551381827f3f req-561924ea-d9be-4d0d-a7cc-5a4ae5ac7ccd service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:26.941224 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-99a19417-ad96-49c4-bda4-551381827f3f req-561924ea-d9be-4d0d-a7cc-5a4ae5ac7ccd service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:26.954857 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-99a19417-ad96-49c4-bda4-551381827f3f req-561924ea-d9be-4d0d-a7cc-5a4ae5ac7ccd service nova] Creating event network-vif-plugged:78bad9ba-f468-4e03-9786-7c27cd0658de for instance ed5b3d28-2f47-4309-a909-0210c782aad3 on hv-cinder-84984 Jul 31 14:25:26.962990 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-99a19417-ad96-49c4-bda4-551381827f3f req-561924ea-d9be-4d0d-a7cc-5a4ae5ac7ccd service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037383 Jul 31 14:25:26.965364 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 192/383] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:25:27.023753 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-19caf45b-a206-4a32-9bff-dfbafdb33195 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675171 Jul 31 14:25:27.026778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 192/384] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Jul 31 14:25:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 14:25:27.036391 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a3a0427a-d145-4bf0-a4b6-19be2953b5df tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:27.037842 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a3a0427a-d145-4bf0-a4b6-19be2953b5df tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:27.089467 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-9e841263-3b83-419c-b787-04f4a8ee0724 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:27.090932 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-9e841263-3b83-419c-b787-04f4a8ee0724 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:27.108320 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9e841263-3b83-419c-b787-04f4a8ee0724 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:27.108790 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9e841263-3b83-419c-b787-04f4a8ee0724 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:27.116022 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9e841263-3b83-419c-b787-04f4a8ee0724 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:27.116806 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9e841263-3b83-419c-b787-04f4a8ee0724 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:27.233621 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a3a0427a-d145-4bf0-a4b6-19be2953b5df tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:27.245931 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a3a0427a-d145-4bf0-a4b6-19be2953b5df tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1215 microversion: 2.1 time: 0.213781 Jul 31 14:25:27.247039 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 193/385] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:27 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1215 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:27.376330 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-9e841263-3b83-419c-b787-04f4a8ee0724 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:27.388219 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-9e841263-3b83-419c-b787-04f4a8ee0724 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:27.390781 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-9e841263-3b83-419c-b787-04f4a8ee0724 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:27.392772 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-9e841263-3b83-419c-b787-04f4a8ee0724 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1740 microversion: 2.20 time: 0.307554 Jul 31 14:25:27.399398 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 193/386] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:27 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1740 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:25:27.930338 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a59ee3a2-707b-4ab1-8574-0806408a9377 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:27.930939 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a59ee3a2-707b-4ab1-8574-0806408a9377 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:27.941136 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a59ee3a2-707b-4ab1-8574-0806408a9377 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:27.941936 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a59ee3a2-707b-4ab1-8574-0806408a9377 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:27.942824 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a59ee3a2-707b-4ab1-8574-0806408a9377 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:27.943323 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a59ee3a2-707b-4ab1-8574-0806408a9377 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:28.126268 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-db262287-c35c-459f-8ee9-bbec2511ec0c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1713646136", "imageRef": "57bc051a-64d0-4317-aa93-a7a2aed39369", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f5e1ec66-f0ed-4d21-aa4b-ff4b55a9259a"}], "security_groups": [{"name": "tempest-securitygroup--2002375760"}], "key_name": "tempest-keypair-1769865524", "user_data": "}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:25:28.181325 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a59ee3a2-707b-4ab1-8574-0806408a9377 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:28.189281 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a59ee3a2-707b-4ab1-8574-0806408a9377 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 200 len: 1367 microversion: 2.1 time: 0.263803 Jul 31 14:25:28.190683 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 194/387] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:27 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:28.269948 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-bdd89766-c940-4a55-92ae-e59cc1f4715c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:28.270649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-bdd89766-c940-4a55-92ae-e59cc1f4715c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:28.279463 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.network.neutron [None req-db262287-c35c-459f-8ee9-bbec2511ec0c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] validate_networks() for [('f5e1ec66-f0ed-4d21-aa4b-ff4b55a9259a', None, None, None, None, None)] {{(pid=117781) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 14:25:28.283170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bdd89766-c940-4a55-92ae-e59cc1f4715c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:28.285372 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bdd89766-c940-4a55-92ae-e59cc1f4715c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:28.288595 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bdd89766-c940-4a55-92ae-e59cc1f4715c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:28.289105 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bdd89766-c940-4a55-92ae-e59cc1f4715c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:28.400951 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bdd89766-c940-4a55-92ae-e59cc1f4715c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:28.411636 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-bdd89766-c940-4a55-92ae-e59cc1f4715c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1219 microversion: 2.1 time: 0.145810 Jul 31 14:25:28.413085 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 195/388] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:28 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1219 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:28.434473 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-81337cab-5c53-4041-b0b2-a81436d72fe1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:28.437044 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-81337cab-5c53-4041-b0b2-a81436d72fe1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:28.446267 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-81337cab-5c53-4041-b0b2-a81436d72fe1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:28.447541 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-81337cab-5c53-4041-b0b2-a81436d72fe1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:28.448525 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-81337cab-5c53-4041-b0b2-a81436d72fe1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:28.449660 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-81337cab-5c53-4041-b0b2-a81436d72fe1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:28.638279 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-81337cab-5c53-4041-b0b2-a81436d72fe1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:28.648171 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-81337cab-5c53-4041-b0b2-a81436d72fe1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:28.648995 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-81337cab-5c53-4041-b0b2-a81436d72fe1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:28.650567 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-81337cab-5c53-4041-b0b2-a81436d72fe1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1740 microversion: 2.20 time: 0.227962 Jul 31 14:25:28.651870 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 196/389] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:28 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:25:28.824498 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-db262287-c35c-459f-8ee9-bbec2511ec0c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Flavor limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 14:25:28.824999 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-db262287-c35c-459f-8ee9-bbec2511ec0c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Image limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 14:25:28.825816 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-db262287-c35c-459f-8ee9-bbec2511ec0c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Flavor pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 14:25:28.826320 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-db262287-c35c-459f-8ee9-bbec2511ec0c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Image pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 14:25:28.826799 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-db262287-c35c-459f-8ee9-bbec2511ec0c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 14:25:28.840207 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-db262287-c35c-459f-8ee9-bbec2511ec0c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:28.841172 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-db262287-c35c-459f-8ee9-bbec2511ec0c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:28.841986 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-db262287-c35c-459f-8ee9-bbec2511ec0c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:28.842426 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-db262287-c35c-459f-8ee9-bbec2511ec0c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:28.861681 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-db262287-c35c-459f-8ee9-bbec2511ec0c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Getting quotas for project 832629dd8594494ab41b6596b2d73076. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:25:28.866318 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-db262287-c35c-459f-8ee9-bbec2511ec0c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Getting quotas for user 10a4469c46f64feb819f3b19a0f4e89b and project 832629dd8594494ab41b6596b2d73076. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:25:28.882528 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-db262287-c35c-459f-8ee9-bbec2511ec0c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Going to run 1 instances... {{(pid=117781) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 14:25:28.884681 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-db262287-c35c-459f-8ee9-bbec2511ec0c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57bc051a-64d0-4317-aa93-a7a2aed39369',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117781) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 14:25:28.948052 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-db262287-c35c-459f-8ee9-bbec2511ec0c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.833525 Jul 31 14:25:28.948782 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 194/390] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Jul 31 14:25:28 2022] POST /compute/v2.1/servers => generated 409 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 14:25:28.960141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1117a412-2829-4281-91b6-09f2e8c42875 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:28.961478 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1117a412-2829-4281-91b6-09f2e8c42875 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:29.031197 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1117a412-2829-4281-91b6-09f2e8c42875 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:29.038950 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1117a412-2829-4281-91b6-09f2e8c42875 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1246 microversion: 2.1 time: 0.082720 Jul 31 14:25:29.040635 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 197/391] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:28 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:29.214366 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-fb47b4fb-76c8-4994-8221-c87764144354 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:29.214926 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-fb47b4fb-76c8-4994-8221-c87764144354 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:29.237801 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fb47b4fb-76c8-4994-8221-c87764144354 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:29.239708 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fb47b4fb-76c8-4994-8221-c87764144354 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:29.241279 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fb47b4fb-76c8-4994-8221-c87764144354 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:29.242083 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fb47b4fb-76c8-4994-8221-c87764144354 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:29.409744 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-fb47b4fb-76c8-4994-8221-c87764144354 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:29.419683 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-fb47b4fb-76c8-4994-8221-c87764144354 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 200 len: 1367 microversion: 2.1 time: 0.209639 Jul 31 14:25:29.434785 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 195/392] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:29 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:29.435007 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2fc637d5-dc83-469c-91a0-a09ee5abe0ea tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:29.435736 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2fc637d5-dc83-469c-91a0-a09ee5abe0ea tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:29.444816 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2fc637d5-dc83-469c-91a0-a09ee5abe0ea tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:29.446888 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2fc637d5-dc83-469c-91a0-a09ee5abe0ea tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:29.447841 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2fc637d5-dc83-469c-91a0-a09ee5abe0ea tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:29.451727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2fc637d5-dc83-469c-91a0-a09ee5abe0ea tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:29.550632 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2fc637d5-dc83-469c-91a0-a09ee5abe0ea tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:29.562779 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2fc637d5-dc83-469c-91a0-a09ee5abe0ea tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1267 microversion: 2.1 time: 0.131849 Jul 31 14:25:29.568114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 198/393] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:29 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:29.684121 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-065ec524-d168-4a8c-ba6d-083a911f5a4e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:29.686097 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-065ec524-d168-4a8c-ba6d-083a911f5a4e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:29.697136 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-065ec524-d168-4a8c-ba6d-083a911f5a4e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:29.697872 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-065ec524-d168-4a8c-ba6d-083a911f5a4e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:29.698889 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-065ec524-d168-4a8c-ba6d-083a911f5a4e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:29.699514 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-065ec524-d168-4a8c-ba6d-083a911f5a4e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:29.972223 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-065ec524-d168-4a8c-ba6d-083a911f5a4e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:29.983182 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-065ec524-d168-4a8c-ba6d-083a911f5a4e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:29.988774 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-065ec524-d168-4a8c-ba6d-083a911f5a4e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:29.990048 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-065ec524-d168-4a8c-ba6d-083a911f5a4e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1740 microversion: 2.20 time: 0.316835 Jul 31 14:25:29.991457 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 196/394] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:29 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1740 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:30.066293 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-65439f28-0749-4b68-b016-f5ccf3f96614 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:30.068162 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-65439f28-0749-4b68-b016-f5ccf3f96614 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:30.080629 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-65439f28-0749-4b68-b016-f5ccf3f96614 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:30.081092 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-65439f28-0749-4b68-b016-f5ccf3f96614 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:30.084255 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-65439f28-0749-4b68-b016-f5ccf3f96614 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:30.085974 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-65439f28-0749-4b68-b016-f5ccf3f96614 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:30.181929 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-65439f28-0749-4b68-b016-f5ccf3f96614 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:30.192303 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-65439f28-0749-4b68-b016-f5ccf3f96614 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1242 microversion: 2.1 time: 0.135220 Jul 31 14:25:30.193273 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 199/395] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:30 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1242 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:30.441813 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-97af4bb2-ab83-4156-85b0-e49dac2798dd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:30.442471 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-97af4bb2-ab83-4156-85b0-e49dac2798dd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:30.449339 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-97af4bb2-ab83-4156-85b0-e49dac2798dd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:30.449782 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-97af4bb2-ab83-4156-85b0-e49dac2798dd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:30.451002 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-97af4bb2-ab83-4156-85b0-e49dac2798dd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:30.451473 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-97af4bb2-ab83-4156-85b0-e49dac2798dd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:30.598659 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-578f5ebd-7e56-43f3-8f30-d53ea48cd74c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:30.602187 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-578f5ebd-7e56-43f3-8f30-d53ea48cd74c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:30.613887 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-578f5ebd-7e56-43f3-8f30-d53ea48cd74c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:30.616441 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-578f5ebd-7e56-43f3-8f30-d53ea48cd74c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:30.617456 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-578f5ebd-7e56-43f3-8f30-d53ea48cd74c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:30.622151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-578f5ebd-7e56-43f3-8f30-d53ea48cd74c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:30.682533 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-97af4bb2-ab83-4156-85b0-e49dac2798dd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:30.695829 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-97af4bb2-ab83-4156-85b0-e49dac2798dd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 200 len: 1558 microversion: 2.1 time: 0.257757 Jul 31 14:25:30.710842 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 197/396] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:30 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 1558 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:30.723719 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-db7b78bc-762d-4546-8f48-8a3426b6c9dc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:30.725469 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-db7b78bc-762d-4546-8f48-8a3426b6c9dc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:30.727975 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-578f5ebd-7e56-43f3-8f30-d53ea48cd74c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:30.736351 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-578f5ebd-7e56-43f3-8f30-d53ea48cd74c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1273 microversion: 2.1 time: 0.146317 Jul 31 14:25:30.737681 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 200/397] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:30 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1273 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:30.744764 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-db7b78bc-762d-4546-8f48-8a3426b6c9dc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:30.745532 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-db7b78bc-762d-4546-8f48-8a3426b6c9dc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:30.746537 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-db7b78bc-762d-4546-8f48-8a3426b6c9dc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:30.747165 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-db7b78bc-762d-4546-8f48-8a3426b6c9dc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:30.925700 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-db7b78bc-762d-4546-8f48-8a3426b6c9dc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.208357 Jul 31 14:25:30.926383 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 198/398] 10.222.0.40 () {58 vars in 1275 bytes} [Sun Jul 31 14:25:30 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3/os-interface => generated 285 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:25:31.016894 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-909c08ce-f63b-42cb-b118-2d0d13ea70d0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:31.017366 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-909c08ce-f63b-42cb-b118-2d0d13ea70d0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:31.035936 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-909c08ce-f63b-42cb-b118-2d0d13ea70d0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:31.036399 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-909c08ce-f63b-42cb-b118-2d0d13ea70d0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:31.037914 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-909c08ce-f63b-42cb-b118-2d0d13ea70d0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:31.038363 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-909c08ce-f63b-42cb-b118-2d0d13ea70d0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:31.214446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-9e6bd7c6-4c4d-4e92-abb9-0b4ee719e8db tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:31.215052 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-9e6bd7c6-4c4d-4e92-abb9-0b4ee719e8db tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:31.223377 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9e6bd7c6-4c4d-4e92-abb9-0b4ee719e8db tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:31.227647 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9e6bd7c6-4c4d-4e92-abb9-0b4ee719e8db tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:31.228471 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9e6bd7c6-4c4d-4e92-abb9-0b4ee719e8db tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:31.228923 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9e6bd7c6-4c4d-4e92-abb9-0b4ee719e8db tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:31.320655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-909c08ce-f63b-42cb-b118-2d0d13ea70d0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:31.324360 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=100 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:25:31.336628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-909c08ce-f63b-42cb-b118-2d0d13ea70d0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:31.339787 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-909c08ce-f63b-42cb-b118-2d0d13ea70d0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:31.343118 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-909c08ce-f63b-42cb-b118-2d0d13ea70d0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1740 microversion: 2.20 time: 0.330926 Jul 31 14:25:31.347008 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 201/399] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:31 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1740 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:25:31.416369 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-9e6bd7c6-4c4d-4e92-abb9-0b4ee719e8db tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:31.427747 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-9e6bd7c6-4c4d-4e92-abb9-0b4ee719e8db tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1304 microversion: 2.1 time: 0.215575 Jul 31 14:25:31.429947 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 199/400] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:31 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1304 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:31.760762 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8d08f204-e915-4b7e-b5eb-f30df3bf12f4 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:31.761519 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8d08f204-e915-4b7e-b5eb-f30df3bf12f4 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:31.765334 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:25:31.776670 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8d08f204-e915-4b7e-b5eb-f30df3bf12f4 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:31.777124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8d08f204-e915-4b7e-b5eb-f30df3bf12f4 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:31.777916 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8d08f204-e915-4b7e-b5eb-f30df3bf12f4 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:31.778355 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8d08f204-e915-4b7e-b5eb-f30df3bf12f4 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:31.898041 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8d08f204-e915-4b7e-b5eb-f30df3bf12f4 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:31.906641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8d08f204-e915-4b7e-b5eb-f30df3bf12f4 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1273 microversion: 2.1 time: 0.149856 Jul 31 14:25:31.920651 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 202/401] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:31 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:32.374252 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-e0005236-dbb8-48c4-9ea2-f37d065be456 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:32.375631 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-e0005236-dbb8-48c4-9ea2-f37d065be456 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:32.391730 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e0005236-dbb8-48c4-9ea2-f37d065be456 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:32.392766 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e0005236-dbb8-48c4-9ea2-f37d065be456 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:32.395372 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e0005236-dbb8-48c4-9ea2-f37d065be456 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:32.396984 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e0005236-dbb8-48c4-9ea2-f37d065be456 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:32.451310 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c0e0497a-8bf2-4625-884b-1b5204cc3f84 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:32.454500 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c0e0497a-8bf2-4625-884b-1b5204cc3f84 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:32.466401 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c0e0497a-8bf2-4625-884b-1b5204cc3f84 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:32.467307 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c0e0497a-8bf2-4625-884b-1b5204cc3f84 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:32.469234 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c0e0497a-8bf2-4625-884b-1b5204cc3f84 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:32.483352 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c0e0497a-8bf2-4625-884b-1b5204cc3f84 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:32.785059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c0e0497a-8bf2-4625-884b-1b5204cc3f84 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:32.806034 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c0e0497a-8bf2-4625-884b-1b5204cc3f84 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1372 microversion: 2.1 time: 0.358590 Jul 31 14:25:32.807359 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 203/402] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:32 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1372 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:32.813647 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-5add24ee-2d17-427a-a5d9-65d0333164b8 req-f96e62a5-f9bf-4ed1-a670-3d2d24c3648d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed5b3d28-2f47-4309-a909-0210c782aad3", "tag": "78bad9ba-f468-4e03-9786-7c27cd0658de"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:25:32.838385 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-5add24ee-2d17-427a-a5d9-65d0333164b8 req-f96e62a5-f9bf-4ed1-a670-3d2d24c3648d service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:32.838935 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-5add24ee-2d17-427a-a5d9-65d0333164b8 req-f96e62a5-f9bf-4ed1-a670-3d2d24c3648d service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:32.852352 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-5add24ee-2d17-427a-a5d9-65d0333164b8 req-f96e62a5-f9bf-4ed1-a670-3d2d24c3648d service nova] Creating event network-changed:78bad9ba-f468-4e03-9786-7c27cd0658de for instance ed5b3d28-2f47-4309-a909-0210c782aad3 on hv-cinder-84984 Jul 31 14:25:32.858309 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-5add24ee-2d17-427a-a5d9-65d0333164b8 req-f96e62a5-f9bf-4ed1-a670-3d2d24c3648d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049065 Jul 31 14:25:32.870557 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 204/403] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:25:32.930812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-04ebec1a-c79f-465c-a715-4073c18c7e9a tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:32.931577 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-04ebec1a-c79f-465c-a715-4073c18c7e9a tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:32.942872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-04ebec1a-c79f-465c-a715-4073c18c7e9a tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:32.943351 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-04ebec1a-c79f-465c-a715-4073c18c7e9a tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:32.946908 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-04ebec1a-c79f-465c-a715-4073c18c7e9a tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:32.947362 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-04ebec1a-c79f-465c-a715-4073c18c7e9a tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:33.120516 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e0005236-dbb8-48c4-9ea2-f37d065be456 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:33.148173 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e0005236-dbb8-48c4-9ea2-f37d065be456 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:33.149833 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e0005236-dbb8-48c4-9ea2-f37d065be456 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:33.151056 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-e0005236-dbb8-48c4-9ea2-f37d065be456 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1740 microversion: 2.20 time: 0.783961 Jul 31 14:25:33.155745 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 200/404] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:32 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1740 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:33.677234 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-04ebec1a-c79f-465c-a715-4073c18c7e9a tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:33.689216 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-04ebec1a-c79f-465c-a715-4073c18c7e9a tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1315 microversion: 2.1 time: 0.763211 Jul 31 14:25:33.706151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 205/405] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:32 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1315 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:33.828478 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-509ebd2f-43b6-4dec-87c7-2a47f2c01a40 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:33.829150 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-509ebd2f-43b6-4dec-87c7-2a47f2c01a40 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:33.840644 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-509ebd2f-43b6-4dec-87c7-2a47f2c01a40 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:33.846002 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-509ebd2f-43b6-4dec-87c7-2a47f2c01a40 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:33.848232 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-509ebd2f-43b6-4dec-87c7-2a47f2c01a40 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:33.848676 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-509ebd2f-43b6-4dec-87c7-2a47f2c01a40 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:34.178642 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fcb8ec27-d185-4040-b637-3056bcb463fd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:34.179264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fcb8ec27-d185-4040-b637-3056bcb463fd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:34.191699 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fcb8ec27-d185-4040-b637-3056bcb463fd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:34.196989 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fcb8ec27-d185-4040-b637-3056bcb463fd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:34.198296 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fcb8ec27-d185-4040-b637-3056bcb463fd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:34.199084 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fcb8ec27-d185-4040-b637-3056bcb463fd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:34.454989 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-509ebd2f-43b6-4dec-87c7-2a47f2c01a40 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:34.472040 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-509ebd2f-43b6-4dec-87c7-2a47f2c01a40 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1372 microversion: 2.1 time: 0.647227 Jul 31 14:25:34.486184 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 201/406] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:33 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1372 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:34.566901 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fcb8ec27-d185-4040-b637-3056bcb463fd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:34.585869 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fcb8ec27-d185-4040-b637-3056bcb463fd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:34.594902 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fcb8ec27-d185-4040-b637-3056bcb463fd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:34.596387 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fcb8ec27-d185-4040-b637-3056bcb463fd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1740 microversion: 2.20 time: 0.422003 Jul 31 14:25:34.614126 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 206/407] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:34 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1740 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:34.718899 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-eec96eb6-c6ff-4e53-a47b-ce56b23837f6 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:34.720812 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-eec96eb6-c6ff-4e53-a47b-ce56b23837f6 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:34.742599 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eec96eb6-c6ff-4e53-a47b-ce56b23837f6 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:34.744481 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eec96eb6-c6ff-4e53-a47b-ce56b23837f6 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:34.749495 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eec96eb6-c6ff-4e53-a47b-ce56b23837f6 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:34.751555 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eec96eb6-c6ff-4e53-a47b-ce56b23837f6 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:34.840047 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-8e8ada70-dac6-4567-9578-165c67905274 req-da3dddfe-f30f-41c3-bdad-2129bebbb03d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60", "tag": "8d6613a4-de2a-4912-9a33-a4914a893c16"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:25:34.857282 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-8e8ada70-dac6-4567-9578-165c67905274 req-da3dddfe-f30f-41c3-bdad-2129bebbb03d service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:34.857985 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-8e8ada70-dac6-4567-9578-165c67905274 req-da3dddfe-f30f-41c3-bdad-2129bebbb03d service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:34.873767 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-8e8ada70-dac6-4567-9578-165c67905274 req-da3dddfe-f30f-41c3-bdad-2129bebbb03d service nova] Creating event network-changed:8d6613a4-de2a-4912-9a33-a4914a893c16 for instance 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 on hv-cinder-84984 Jul 31 14:25:34.885763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-8e8ada70-dac6-4567-9578-165c67905274 req-da3dddfe-f30f-41c3-bdad-2129bebbb03d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049583 Jul 31 14:25:34.887095 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 207/408] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:25:35.198469 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-eec96eb6-c6ff-4e53-a47b-ce56b23837f6 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:35.214893 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-eec96eb6-c6ff-4e53-a47b-ce56b23837f6 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1315 microversion: 2.1 time: 0.503569 Jul 31 14:25:35.217655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 202/409] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:34 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:35.497868 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-bdfdbaf5-cf58-465b-9867-677ec6c603d7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:35.498866 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-bdfdbaf5-cf58-465b-9867-677ec6c603d7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:35.512657 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bdfdbaf5-cf58-465b-9867-677ec6c603d7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:35.514555 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bdfdbaf5-cf58-465b-9867-677ec6c603d7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:35.515612 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bdfdbaf5-cf58-465b-9867-677ec6c603d7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:35.516339 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bdfdbaf5-cf58-465b-9867-677ec6c603d7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:35.625179 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-cd331cd7-f54f-4b24-a272-a527a90acc31 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:35.626342 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-cd331cd7-f54f-4b24-a272-a527a90acc31 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:35.637059 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-cd331cd7-f54f-4b24-a272-a527a90acc31 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:35.640478 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-cd331cd7-f54f-4b24-a272-a527a90acc31 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:35.641536 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-cd331cd7-f54f-4b24-a272-a527a90acc31 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:35.643309 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-cd331cd7-f54f-4b24-a272-a527a90acc31 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:35.763476 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bdfdbaf5-cf58-465b-9867-677ec6c603d7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:35.773558 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-bdfdbaf5-cf58-465b-9867-677ec6c603d7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1372 microversion: 2.1 time: 0.281701 Jul 31 14:25:35.774890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 208/410] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:35 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1372 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:36.013384 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-cd331cd7-f54f-4b24-a272-a527a90acc31 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:36.022271 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-cd331cd7-f54f-4b24-a272-a527a90acc31 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:36.024087 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-cd331cd7-f54f-4b24-a272-a527a90acc31 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:36.025449 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-cd331cd7-f54f-4b24-a272-a527a90acc31 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1740 microversion: 2.20 time: 0.405108 Jul 31 14:25:36.026006 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 203/411] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:35 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1740 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:25:36.239739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c6b17ca6-b8da-4238-abfa-cbad1031ca61 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:36.241738 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c6b17ca6-b8da-4238-abfa-cbad1031ca61 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:36.255233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c6b17ca6-b8da-4238-abfa-cbad1031ca61 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:36.256820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c6b17ca6-b8da-4238-abfa-cbad1031ca61 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:36.257985 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c6b17ca6-b8da-4238-abfa-cbad1031ca61 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:36.259599 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c6b17ca6-b8da-4238-abfa-cbad1031ca61 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:36.427173 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c6b17ca6-b8da-4238-abfa-cbad1031ca61 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:36.437156 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c6b17ca6-b8da-4238-abfa-cbad1031ca61 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1315 microversion: 2.1 time: 0.200452 Jul 31 14:25:36.439738 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 209/412] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:36 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:36.796092 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-09cee4de-79f8-4223-ac2f-b908ddfb8291 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:36.796814 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-09cee4de-79f8-4223-ac2f-b908ddfb8291 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:36.805312 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-09cee4de-79f8-4223-ac2f-b908ddfb8291 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:36.805757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-09cee4de-79f8-4223-ac2f-b908ddfb8291 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:36.806517 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-09cee4de-79f8-4223-ac2f-b908ddfb8291 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:36.806968 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-09cee4de-79f8-4223-ac2f-b908ddfb8291 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:36.942358 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-69546cdd-cb58-46f3-97f6-1de4fdc03c1e req-ba0aba88-803b-478d-b39f-1ea28e9f826d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337cbeb6-512e-4bf5-bd53-cd837c00947e", "tag": "8cbcf7d3-6045-42ae-b5a4-ef6ca863d210"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:25:36.953531 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-69546cdd-cb58-46f3-97f6-1de4fdc03c1e req-ba0aba88-803b-478d-b39f-1ea28e9f826d service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:36.954408 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-69546cdd-cb58-46f3-97f6-1de4fdc03c1e req-ba0aba88-803b-478d-b39f-1ea28e9f826d service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:36.965003 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-09cee4de-79f8-4223-ac2f-b908ddfb8291 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:36.969134 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-69546cdd-cb58-46f3-97f6-1de4fdc03c1e req-ba0aba88-803b-478d-b39f-1ea28e9f826d service nova] Creating event network-changed:8cbcf7d3-6045-42ae-b5a4-ef6ca863d210 for instance 337cbeb6-512e-4bf5-bd53-cd837c00947e on hv-cinder-84984 Jul 31 14:25:36.975768 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-69546cdd-cb58-46f3-97f6-1de4fdc03c1e req-ba0aba88-803b-478d-b39f-1ea28e9f826d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036967 Jul 31 14:25:36.976618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 210/413] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:25:36.985222 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-09cee4de-79f8-4223-ac2f-b908ddfb8291 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1372 microversion: 2.1 time: 0.194438 Jul 31 14:25:36.985962 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 204/414] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:36 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1372 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:37.052375 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6778c7fd-83bc-48a0-a017-2d1f556f984d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:37.052996 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6778c7fd-83bc-48a0-a017-2d1f556f984d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:37.059930 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6778c7fd-83bc-48a0-a017-2d1f556f984d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:37.060560 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6778c7fd-83bc-48a0-a017-2d1f556f984d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:37.061495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6778c7fd-83bc-48a0-a017-2d1f556f984d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:37.062135 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6778c7fd-83bc-48a0-a017-2d1f556f984d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:37.211069 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6778c7fd-83bc-48a0-a017-2d1f556f984d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:37.219322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6778c7fd-83bc-48a0-a017-2d1f556f984d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:37.220952 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6778c7fd-83bc-48a0-a017-2d1f556f984d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:37.222194 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6778c7fd-83bc-48a0-a017-2d1f556f984d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1740 microversion: 2.20 time: 0.174060 Jul 31 14:25:37.223823 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 211/415] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:37 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:25:37.458396 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-947e91f5-7e10-4939-a9ef-ba03ebce5ae3 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:37.459640 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-947e91f5-7e10-4939-a9ef-ba03ebce5ae3 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:37.466115 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-947e91f5-7e10-4939-a9ef-ba03ebce5ae3 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:37.466573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-947e91f5-7e10-4939-a9ef-ba03ebce5ae3 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:37.467364 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-947e91f5-7e10-4939-a9ef-ba03ebce5ae3 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:37.467840 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-947e91f5-7e10-4939-a9ef-ba03ebce5ae3 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:37.631673 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-947e91f5-7e10-4939-a9ef-ba03ebce5ae3 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:37.639224 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-947e91f5-7e10-4939-a9ef-ba03ebce5ae3 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1315 microversion: 2.1 time: 0.184841 Jul 31 14:25:37.639810 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 205/416] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:37 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:38.014921 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fb48acbb-87d6-484a-9593-6a47dee5cd1c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:38.016797 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fb48acbb-87d6-484a-9593-6a47dee5cd1c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:38.023910 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fb48acbb-87d6-484a-9593-6a47dee5cd1c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:38.024427 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fb48acbb-87d6-484a-9593-6a47dee5cd1c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:38.025455 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fb48acbb-87d6-484a-9593-6a47dee5cd1c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:38.026109 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fb48acbb-87d6-484a-9593-6a47dee5cd1c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:38.172420 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fb48acbb-87d6-484a-9593-6a47dee5cd1c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:38.180561 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fb48acbb-87d6-484a-9593-6a47dee5cd1c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1372 microversion: 2.1 time: 0.169971 Jul 31 14:25:38.181124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 212/417] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:38 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:38.246952 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-5316cd55-9e09-4964-924e-d0e8aca0d8a1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:38.247539 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-5316cd55-9e09-4964-924e-d0e8aca0d8a1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:38.254338 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5316cd55-9e09-4964-924e-d0e8aca0d8a1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:38.254785 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5316cd55-9e09-4964-924e-d0e8aca0d8a1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:38.255785 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5316cd55-9e09-4964-924e-d0e8aca0d8a1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:38.256226 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5316cd55-9e09-4964-924e-d0e8aca0d8a1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:38.392912 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-5316cd55-9e09-4964-924e-d0e8aca0d8a1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:38.400983 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-5316cd55-9e09-4964-924e-d0e8aca0d8a1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:38.402474 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-5316cd55-9e09-4964-924e-d0e8aca0d8a1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:38.403638 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-5316cd55-9e09-4964-924e-d0e8aca0d8a1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1740 microversion: 2.20 time: 0.160724 Jul 31 14:25:38.404180 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 206/418] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:38 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:38.660573 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d08bb25f-f2b3-4c78-877e-ac51814cbb0e tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:38.661187 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d08bb25f-f2b3-4c78-877e-ac51814cbb0e tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:38.667873 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d08bb25f-f2b3-4c78-877e-ac51814cbb0e tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:38.668323 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d08bb25f-f2b3-4c78-877e-ac51814cbb0e tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:38.669088 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d08bb25f-f2b3-4c78-877e-ac51814cbb0e tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:38.669526 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d08bb25f-f2b3-4c78-877e-ac51814cbb0e tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:38.798609 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d08bb25f-f2b3-4c78-877e-ac51814cbb0e tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:38.806004 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d08bb25f-f2b3-4c78-877e-ac51814cbb0e tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1315 microversion: 2.1 time: 0.149244 Jul 31 14:25:38.806571 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 213/419] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:38 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:39.201230 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-9596a720-0ec8-4e13-ab63-0c39ea9f8df4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:39.201858 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-9596a720-0ec8-4e13-ab63-0c39ea9f8df4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:39.203699 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=4 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:25:39.204334 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=16 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:25:39.210207 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9596a720-0ec8-4e13-ab63-0c39ea9f8df4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:39.210651 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9596a720-0ec8-4e13-ab63-0c39ea9f8df4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:39.211400 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9596a720-0ec8-4e13-ab63-0c39ea9f8df4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:39.211859 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9596a720-0ec8-4e13-ab63-0c39ea9f8df4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:39.341180 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-9596a720-0ec8-4e13-ab63-0c39ea9f8df4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:39.348519 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-9596a720-0ec8-4e13-ab63-0c39ea9f8df4 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1372 microversion: 2.1 time: 0.151340 Jul 31 14:25:39.349081 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 207/420] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:39 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:39.426201 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2d6ecf5f-8814-4df6-8689-5a4596bf4d6a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:39.426811 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2d6ecf5f-8814-4df6-8689-5a4596bf4d6a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:39.429197 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=4 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:25:39.434918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2d6ecf5f-8814-4df6-8689-5a4596bf4d6a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:39.435371 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2d6ecf5f-8814-4df6-8689-5a4596bf4d6a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:39.436179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2d6ecf5f-8814-4df6-8689-5a4596bf4d6a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:39.436638 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2d6ecf5f-8814-4df6-8689-5a4596bf4d6a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:39.569500 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2d6ecf5f-8814-4df6-8689-5a4596bf4d6a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:39.577958 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2d6ecf5f-8814-4df6-8689-5a4596bf4d6a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:39.579502 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2d6ecf5f-8814-4df6-8689-5a4596bf4d6a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:39.580658 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2d6ecf5f-8814-4df6-8689-5a4596bf4d6a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1740 microversion: 2.20 time: 0.158522 Jul 31 14:25:39.581239 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 214/421] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:39 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1740 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:39.827593 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-aba6aef3-28cd-4939-a179-9ab65728ca11 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:39.828198 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-aba6aef3-28cd-4939-a179-9ab65728ca11 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:39.830015 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:25:39.836591 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-aba6aef3-28cd-4939-a179-9ab65728ca11 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:39.837042 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-aba6aef3-28cd-4939-a179-9ab65728ca11 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:39.837811 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-aba6aef3-28cd-4939-a179-9ab65728ca11 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:39.838271 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-aba6aef3-28cd-4939-a179-9ab65728ca11 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:39.966521 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-aba6aef3-28cd-4939-a179-9ab65728ca11 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:39.973865 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-aba6aef3-28cd-4939-a179-9ab65728ca11 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1315 microversion: 2.1 time: 0.150384 Jul 31 14:25:39.974433 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 208/422] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:39 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:40.369801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-53ff08e8-1928-4fb0-bdcd-873311865c8c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:40.370325 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-53ff08e8-1928-4fb0-bdcd-873311865c8c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:40.376449 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-53ff08e8-1928-4fb0-bdcd-873311865c8c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:40.376898 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-53ff08e8-1928-4fb0-bdcd-873311865c8c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:40.377663 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-53ff08e8-1928-4fb0-bdcd-873311865c8c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:40.378099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-53ff08e8-1928-4fb0-bdcd-873311865c8c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:40.503991 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-53ff08e8-1928-4fb0-bdcd-873311865c8c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:40.511376 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-53ff08e8-1928-4fb0-bdcd-873311865c8c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1372 microversion: 2.1 time: 0.146205 Jul 31 14:25:40.511961 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 215/423] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:40 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1372 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:40.604498 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-d2320d73-e953-4eda-92f3-fab8a7a0a098 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:40.605110 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-d2320d73-e953-4eda-92f3-fab8a7a0a098 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:40.611624 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d2320d73-e953-4eda-92f3-fab8a7a0a098 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:40.612082 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d2320d73-e953-4eda-92f3-fab8a7a0a098 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:40.612847 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d2320d73-e953-4eda-92f3-fab8a7a0a098 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:40.613287 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d2320d73-e953-4eda-92f3-fab8a7a0a098 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:40.739161 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-d2320d73-e953-4eda-92f3-fab8a7a0a098 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:40.747211 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-d2320d73-e953-4eda-92f3-fab8a7a0a098 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:40.748765 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-d2320d73-e953-4eda-92f3-fab8a7a0a098 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:40.749928 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-d2320d73-e953-4eda-92f3-fab8a7a0a098 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1740 microversion: 2.20 time: 0.149286 Jul 31 14:25:40.750488 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 209/424] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:40 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1740 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:40.994340 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c5e65161-b714-48cd-acd1-8116aee94072 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:40.994981 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c5e65161-b714-48cd-acd1-8116aee94072 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:41.001005 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c5e65161-b714-48cd-acd1-8116aee94072 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:41.001453 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c5e65161-b714-48cd-acd1-8116aee94072 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:41.002218 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c5e65161-b714-48cd-acd1-8116aee94072 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:41.002654 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c5e65161-b714-48cd-acd1-8116aee94072 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:41.131869 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c5e65161-b714-48cd-acd1-8116aee94072 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:41.139296 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c5e65161-b714-48cd-acd1-8116aee94072 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1315 microversion: 2.1 time: 0.148906 Jul 31 14:25:41.139896 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 216/425] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:40 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:41.531740 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-ff83ea5b-9f3f-4416-9ad2-608a09a2f1d5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:41.532340 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-ff83ea5b-9f3f-4416-9ad2-608a09a2f1d5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:41.538290 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ff83ea5b-9f3f-4416-9ad2-608a09a2f1d5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:41.538738 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ff83ea5b-9f3f-4416-9ad2-608a09a2f1d5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:41.539522 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ff83ea5b-9f3f-4416-9ad2-608a09a2f1d5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:41.539956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ff83ea5b-9f3f-4416-9ad2-608a09a2f1d5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:41.557653 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=100 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:25:41.669542 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-ff83ea5b-9f3f-4416-9ad2-608a09a2f1d5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:41.676857 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-ff83ea5b-9f3f-4416-9ad2-608a09a2f1d5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1372 microversion: 2.1 time: 0.149442 Jul 31 14:25:41.677911 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 210/426] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:41 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:41.771809 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-92319f15-0d5b-48ca-b655-7d72a7e06787 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:41.772435 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-92319f15-0d5b-48ca-b655-7d72a7e06787 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:41.779976 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-92319f15-0d5b-48ca-b655-7d72a7e06787 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:41.780413 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-92319f15-0d5b-48ca-b655-7d72a7e06787 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:41.781172 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-92319f15-0d5b-48ca-b655-7d72a7e06787 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:41.781600 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-92319f15-0d5b-48ca-b655-7d72a7e06787 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:41.914012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-92319f15-0d5b-48ca-b655-7d72a7e06787 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:41.921862 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-92319f15-0d5b-48ca-b655-7d72a7e06787 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:41.923290 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-92319f15-0d5b-48ca-b655-7d72a7e06787 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:41.924452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-92319f15-0d5b-48ca-b655-7d72a7e06787 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1740 microversion: 2.20 time: 0.156577 Jul 31 14:25:41.925010 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 217/427] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:41 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:42.159897 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-4dbcf8a9-f7b4-4672-8303-bd57f8bcd543 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:42.160510 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-4dbcf8a9-f7b4-4672-8303-bd57f8bcd543 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:42.166977 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4dbcf8a9-f7b4-4672-8303-bd57f8bcd543 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:42.167440 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4dbcf8a9-f7b4-4672-8303-bd57f8bcd543 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:42.168236 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4dbcf8a9-f7b4-4672-8303-bd57f8bcd543 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:42.168674 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4dbcf8a9-f7b4-4672-8303-bd57f8bcd543 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:42.294953 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-4dbcf8a9-f7b4-4672-8303-bd57f8bcd543 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:42.302438 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-4dbcf8a9-f7b4-4672-8303-bd57f8bcd543 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1315 microversion: 2.1 time: 0.146341 Jul 31 14:25:42.303011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 211/428] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:42 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:42.697749 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-94131175-e420-4c3c-a73a-39bacf2260b1 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:42.698362 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-94131175-e420-4c3c-a73a-39bacf2260b1 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:42.704600 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-94131175-e420-4c3c-a73a-39bacf2260b1 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:42.705050 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-94131175-e420-4c3c-a73a-39bacf2260b1 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:42.705845 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-94131175-e420-4c3c-a73a-39bacf2260b1 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:42.706282 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-94131175-e420-4c3c-a73a-39bacf2260b1 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:42.860553 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-94131175-e420-4c3c-a73a-39bacf2260b1 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:42.869526 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-94131175-e420-4c3c-a73a-39bacf2260b1 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1372 microversion: 2.1 time: 0.175434 Jul 31 14:25:42.870289 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 218/429] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:42 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:42.948298 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-fea7b9df-37d7-4165-9db5-5994740babcc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:42.948828 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-fea7b9df-37d7-4165-9db5-5994740babcc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:42.955243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fea7b9df-37d7-4165-9db5-5994740babcc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:42.955721 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fea7b9df-37d7-4165-9db5-5994740babcc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:42.956485 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fea7b9df-37d7-4165-9db5-5994740babcc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:42.956917 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fea7b9df-37d7-4165-9db5-5994740babcc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:43.155346 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-fea7b9df-37d7-4165-9db5-5994740babcc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:43.163917 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-fea7b9df-37d7-4165-9db5-5994740babcc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:43.165439 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-fea7b9df-37d7-4165-9db5-5994740babcc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:43.166585 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-fea7b9df-37d7-4165-9db5-5994740babcc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1740 microversion: 2.20 time: 0.222162 Jul 31 14:25:43.167150 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 212/430] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:42 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:43.323482 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-67dc8f85-27bf-4d4a-875c-2906fb31193d tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:43.324013 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-67dc8f85-27bf-4d4a-875c-2906fb31193d tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:43.330422 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-67dc8f85-27bf-4d4a-875c-2906fb31193d tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:43.330866 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-67dc8f85-27bf-4d4a-875c-2906fb31193d tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:43.331826 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-67dc8f85-27bf-4d4a-875c-2906fb31193d tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:43.332262 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-67dc8f85-27bf-4d4a-875c-2906fb31193d tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:43.460955 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-67dc8f85-27bf-4d4a-875c-2906fb31193d tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:43.468243 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-67dc8f85-27bf-4d4a-875c-2906fb31193d tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1315 microversion: 2.1 time: 0.148632 Jul 31 14:25:43.468798 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 219/431] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:43 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:43.890329 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-f903efda-6aef-48f9-998d-e7f06fd4beee tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:43.890937 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-f903efda-6aef-48f9-998d-e7f06fd4beee tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:43.896926 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f903efda-6aef-48f9-998d-e7f06fd4beee tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:43.897386 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f903efda-6aef-48f9-998d-e7f06fd4beee tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:43.898161 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f903efda-6aef-48f9-998d-e7f06fd4beee tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:43.898601 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f903efda-6aef-48f9-998d-e7f06fd4beee tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:44.042276 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-f903efda-6aef-48f9-998d-e7f06fd4beee tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:44.050130 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-f903efda-6aef-48f9-998d-e7f06fd4beee tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1372 microversion: 2.1 time: 0.163764 Jul 31 14:25:44.050700 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 213/432] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:43 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:44.192411 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f0f7c9cc-4d8a-4a21-af7e-9698a8ba5ac6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:44.193018 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f0f7c9cc-4d8a-4a21-af7e-9698a8ba5ac6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:44.199629 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0f7c9cc-4d8a-4a21-af7e-9698a8ba5ac6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:44.200079 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0f7c9cc-4d8a-4a21-af7e-9698a8ba5ac6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:44.201099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0f7c9cc-4d8a-4a21-af7e-9698a8ba5ac6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:44.201537 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0f7c9cc-4d8a-4a21-af7e-9698a8ba5ac6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:44.219236 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=100 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:25:44.328628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f0f7c9cc-4d8a-4a21-af7e-9698a8ba5ac6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:44.336700 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f0f7c9cc-4d8a-4a21-af7e-9698a8ba5ac6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:44.338219 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f0f7c9cc-4d8a-4a21-af7e-9698a8ba5ac6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:44.339372 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f0f7c9cc-4d8a-4a21-af7e-9698a8ba5ac6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1740 microversion: 2.20 time: 0.153249 Jul 31 14:25:44.339960 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 220/433] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:44 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:44.488637 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-879a72f1-34cc-4c02-a467-0aaaa5cbe7f6 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:44.489251 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-879a72f1-34cc-4c02-a467-0aaaa5cbe7f6 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:44.495239 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-879a72f1-34cc-4c02-a467-0aaaa5cbe7f6 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:44.495732 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-879a72f1-34cc-4c02-a467-0aaaa5cbe7f6 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:44.496503 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-879a72f1-34cc-4c02-a467-0aaaa5cbe7f6 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:44.496944 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-879a72f1-34cc-4c02-a467-0aaaa5cbe7f6 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:44.633210 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-879a72f1-34cc-4c02-a467-0aaaa5cbe7f6 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:44.640662 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-879a72f1-34cc-4c02-a467-0aaaa5cbe7f6 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1315 microversion: 2.1 time: 0.155831 Jul 31 14:25:44.641297 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 214/434] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:44 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:45.071386 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7be8c7e2-d4be-40fd-b513-5d14fe07a0fe tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:45.072030 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7be8c7e2-d4be-40fd-b513-5d14fe07a0fe tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:45.078285 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7be8c7e2-d4be-40fd-b513-5d14fe07a0fe tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:45.078732 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7be8c7e2-d4be-40fd-b513-5d14fe07a0fe tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:45.079532 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7be8c7e2-d4be-40fd-b513-5d14fe07a0fe tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:45.079982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7be8c7e2-d4be-40fd-b513-5d14fe07a0fe tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:45.210013 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7be8c7e2-d4be-40fd-b513-5d14fe07a0fe tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:45.217425 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7be8c7e2-d4be-40fd-b513-5d14fe07a0fe tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1372 microversion: 2.1 time: 0.150496 Jul 31 14:25:45.217988 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 221/435] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:45 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:45.362247 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-d7afc101-670e-4033-8804-681bd319621b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:45.362867 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-d7afc101-670e-4033-8804-681bd319621b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:45.369275 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d7afc101-670e-4033-8804-681bd319621b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:45.369728 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d7afc101-670e-4033-8804-681bd319621b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:45.370491 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d7afc101-670e-4033-8804-681bd319621b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:45.370932 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d7afc101-670e-4033-8804-681bd319621b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:45.495703 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-d7afc101-670e-4033-8804-681bd319621b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:45.503561 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-d7afc101-670e-4033-8804-681bd319621b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:45.505116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-d7afc101-670e-4033-8804-681bd319621b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:45.506311 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-d7afc101-670e-4033-8804-681bd319621b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1740 microversion: 2.20 time: 0.147999 Jul 31 14:25:45.506873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 215/436] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:45 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1740 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:25:45.661970 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-35957b6d-7b89-4242-8585-f192d3b4d37b tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:45.662566 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-35957b6d-7b89-4242-8585-f192d3b4d37b tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:45.668507 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-35957b6d-7b89-4242-8585-f192d3b4d37b tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:45.668946 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-35957b6d-7b89-4242-8585-f192d3b4d37b tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:45.669695 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-35957b6d-7b89-4242-8585-f192d3b4d37b tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:45.670125 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-35957b6d-7b89-4242-8585-f192d3b4d37b tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:45.795328 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-35957b6d-7b89-4242-8585-f192d3b4d37b tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:45.802627 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-35957b6d-7b89-4242-8585-f192d3b4d37b tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1315 microversion: 2.1 time: 0.144655 Jul 31 14:25:45.803189 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 222/437] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:45 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:46.237590 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-038669b1-e81a-423c-9455-9a48513aaeb7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:46.238198 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-038669b1-e81a-423c-9455-9a48513aaeb7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:46.244669 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-038669b1-e81a-423c-9455-9a48513aaeb7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:46.245110 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-038669b1-e81a-423c-9455-9a48513aaeb7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:46.245863 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-038669b1-e81a-423c-9455-9a48513aaeb7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:46.246299 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-038669b1-e81a-423c-9455-9a48513aaeb7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:46.376953 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-038669b1-e81a-423c-9455-9a48513aaeb7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:46.384652 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-038669b1-e81a-423c-9455-9a48513aaeb7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1372 microversion: 2.1 time: 0.150971 Jul 31 14:25:46.385238 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 216/438] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:46 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:46.530282 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-30736f90-03b1-44dc-b154-2076b4f22149 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:46.531114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-30736f90-03b1-44dc-b154-2076b4f22149 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:46.538212 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-30736f90-03b1-44dc-b154-2076b4f22149 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:46.538685 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-30736f90-03b1-44dc-b154-2076b4f22149 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:46.539480 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-30736f90-03b1-44dc-b154-2076b4f22149 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:46.539918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-30736f90-03b1-44dc-b154-2076b4f22149 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:46.670850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-30736f90-03b1-44dc-b154-2076b4f22149 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:46.679582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-30736f90-03b1-44dc-b154-2076b4f22149 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:46.681097 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-30736f90-03b1-44dc-b154-2076b4f22149 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:46.682252 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-30736f90-03b1-44dc-b154-2076b4f22149 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1740 microversion: 2.20 time: 0.156013 Jul 31 14:25:46.682817 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 223/439] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:46 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:46.823382 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-708f69c6-d7e4-432a-ac97-d581c36ece19 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:46.824010 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-708f69c6-d7e4-432a-ac97-d581c36ece19 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:46.830174 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-708f69c6-d7e4-432a-ac97-d581c36ece19 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:46.830671 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-708f69c6-d7e4-432a-ac97-d581c36ece19 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:46.831444 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-708f69c6-d7e4-432a-ac97-d581c36ece19 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:46.831882 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-708f69c6-d7e4-432a-ac97-d581c36ece19 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:46.962730 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-708f69c6-d7e4-432a-ac97-d581c36ece19 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:46.970105 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-708f69c6-d7e4-432a-ac97-d581c36ece19 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1315 microversion: 2.1 time: 0.150533 Jul 31 14:25:46.970672 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 217/440] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:46 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:47.408160 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-86806608-0d60-4471-abcc-954b983d95e8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:47.408777 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-86806608-0d60-4471-abcc-954b983d95e8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:47.416563 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-86806608-0d60-4471-abcc-954b983d95e8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:47.416851 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-86806608-0d60-4471-abcc-954b983d95e8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:47.417629 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-86806608-0d60-4471-abcc-954b983d95e8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:47.418117 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-86806608-0d60-4471-abcc-954b983d95e8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:47.556230 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-86806608-0d60-4471-abcc-954b983d95e8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:47.563678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-86806608-0d60-4471-abcc-954b983d95e8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1372 microversion: 2.1 time: 0.159864 Jul 31 14:25:47.564416 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 224/441] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:47 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:47.704795 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-5f2dfbb9-fcca-48f2-a121-b17e10f01a39 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:47.705558 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-5f2dfbb9-fcca-48f2-a121-b17e10f01a39 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:47.712360 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5f2dfbb9-fcca-48f2-a121-b17e10f01a39 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:47.713089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5f2dfbb9-fcca-48f2-a121-b17e10f01a39 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:47.714022 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5f2dfbb9-fcca-48f2-a121-b17e10f01a39 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:47.714677 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5f2dfbb9-fcca-48f2-a121-b17e10f01a39 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:47.995215 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-23deb1d4-2aff-485a-a819-38ea685cef32 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:47.995988 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-23deb1d4-2aff-485a-a819-38ea685cef32 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:48.003588 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-23deb1d4-2aff-485a-a819-38ea685cef32 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:48.005733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-23deb1d4-2aff-485a-a819-38ea685cef32 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:48.007274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-23deb1d4-2aff-485a-a819-38ea685cef32 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:48.007963 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-23deb1d4-2aff-485a-a819-38ea685cef32 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:48.032762 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-5f2dfbb9-fcca-48f2-a121-b17e10f01a39 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:48.042752 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-5f2dfbb9-fcca-48f2-a121-b17e10f01a39 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:48.044293 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-5f2dfbb9-fcca-48f2-a121-b17e10f01a39 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:48.045454 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-5f2dfbb9-fcca-48f2-a121-b17e10f01a39 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1722 microversion: 2.20 time: 0.344551 Jul 31 14:25:48.046539 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 218/442] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:47 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1722 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:25:48.236121 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-23deb1d4-2aff-485a-a819-38ea685cef32 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:48.245529 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-23deb1d4-2aff-485a-a819-38ea685cef32 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1315 microversion: 2.1 time: 0.256583 Jul 31 14:25:48.247522 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 225/443] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:47 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:48.585823 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-4f18952c-c90d-4c57-80b5-e5e838f6c211 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:48.586437 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-4f18952c-c90d-4c57-80b5-e5e838f6c211 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:48.592587 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4f18952c-c90d-4c57-80b5-e5e838f6c211 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:48.593042 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4f18952c-c90d-4c57-80b5-e5e838f6c211 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:48.593808 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4f18952c-c90d-4c57-80b5-e5e838f6c211 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:48.594255 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4f18952c-c90d-4c57-80b5-e5e838f6c211 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:48.726491 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-4f18952c-c90d-4c57-80b5-e5e838f6c211 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:48.734242 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-4f18952c-c90d-4c57-80b5-e5e838f6c211 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1372 microversion: 2.1 time: 0.152740 Jul 31 14:25:48.734914 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 219/444] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:48 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:49.070305 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fa049034-92ca-4ed6-ad53-ff9aee2c26c2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:49.071043 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fa049034-92ca-4ed6-ad53-ff9aee2c26c2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:49.078018 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fa049034-92ca-4ed6-ad53-ff9aee2c26c2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:49.078472 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fa049034-92ca-4ed6-ad53-ff9aee2c26c2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:49.079243 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fa049034-92ca-4ed6-ad53-ff9aee2c26c2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:49.079712 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fa049034-92ca-4ed6-ad53-ff9aee2c26c2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:49.213669 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fa049034-92ca-4ed6-ad53-ff9aee2c26c2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:49.221694 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fa049034-92ca-4ed6-ad53-ff9aee2c26c2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:49.223212 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fa049034-92ca-4ed6-ad53-ff9aee2c26c2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:49.224972 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fa049034-92ca-4ed6-ad53-ff9aee2c26c2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1722 microversion: 2.20 time: 0.158859 Jul 31 14:25:49.225671 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 226/445] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:49 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:49.266010 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-aeb12f48-4351-4c9f-9695-ab955d1ebba2 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:49.266620 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-aeb12f48-4351-4c9f-9695-ab955d1ebba2 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:49.273185 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-aeb12f48-4351-4c9f-9695-ab955d1ebba2 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:49.273634 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-aeb12f48-4351-4c9f-9695-ab955d1ebba2 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:49.274404 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-aeb12f48-4351-4c9f-9695-ab955d1ebba2 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:49.274839 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-aeb12f48-4351-4c9f-9695-ab955d1ebba2 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:49.403161 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-aeb12f48-4351-4c9f-9695-ab955d1ebba2 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:49.410432 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-aeb12f48-4351-4c9f-9695-ab955d1ebba2 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1315 microversion: 2.1 time: 0.148289 Jul 31 14:25:49.411133 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 220/446] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:49 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:49.493049 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-d7df95cf-71cd-4182-b462-fdfefe88d116 req-174cac49-108c-4d78-a75e-db39d60b85de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60", "name": "network-vif-plugged", "status": "completed", "tag": "8d6613a4-de2a-4912-9a33-a4914a893c16"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:25:49.503374 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-d7df95cf-71cd-4182-b462-fdfefe88d116 req-174cac49-108c-4d78-a75e-db39d60b85de service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:49.503858 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-d7df95cf-71cd-4182-b462-fdfefe88d116 req-174cac49-108c-4d78-a75e-db39d60b85de service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:49.515211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-d7df95cf-71cd-4182-b462-fdfefe88d116 req-174cac49-108c-4d78-a75e-db39d60b85de service nova] Creating event network-vif-plugged:8d6613a4-de2a-4912-9a33-a4914a893c16 for instance 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 on hv-cinder-84984 Jul 31 14:25:49.520213 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-d7df95cf-71cd-4182-b462-fdfefe88d116 req-174cac49-108c-4d78-a75e-db39d60b85de service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030862 Jul 31 14:25:49.520870 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 227/447] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:25:49.754046 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-aa92708c-3eef-4735-b34a-235daf27e5f5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:49.754657 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-aa92708c-3eef-4735-b34a-235daf27e5f5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:49.762276 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-aa92708c-3eef-4735-b34a-235daf27e5f5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:49.762727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-aa92708c-3eef-4735-b34a-235daf27e5f5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:49.763537 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-aa92708c-3eef-4735-b34a-235daf27e5f5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:49.763977 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-aa92708c-3eef-4735-b34a-235daf27e5f5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:49.900343 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-aa92708c-3eef-4735-b34a-235daf27e5f5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:49.907817 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-aa92708c-3eef-4735-b34a-235daf27e5f5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1372 microversion: 2.1 time: 0.157567 Jul 31 14:25:49.908328 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 221/448] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:49 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:50.249413 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-bb9ffa0a-f7f6-4c57-9350-f8abd28aeef6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:50.250889 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-bb9ffa0a-f7f6-4c57-9350-f8abd28aeef6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:50.258282 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bb9ffa0a-f7f6-4c57-9350-f8abd28aeef6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:50.259255 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bb9ffa0a-f7f6-4c57-9350-f8abd28aeef6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:50.260306 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bb9ffa0a-f7f6-4c57-9350-f8abd28aeef6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:50.260988 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bb9ffa0a-f7f6-4c57-9350-f8abd28aeef6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:50.400771 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bb9ffa0a-f7f6-4c57-9350-f8abd28aeef6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:50.410372 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bb9ffa0a-f7f6-4c57-9350-f8abd28aeef6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:50.412973 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bb9ffa0a-f7f6-4c57-9350-f8abd28aeef6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:50.414643 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-bb9ffa0a-f7f6-4c57-9350-f8abd28aeef6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1722 microversion: 2.20 time: 0.169584 Jul 31 14:25:50.415878 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 228/449] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:50 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:50.432759 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-fcdc921e-8fe9-442c-be8a-92cb3ec62bbc tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:50.433466 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-fcdc921e-8fe9-442c-be8a-92cb3ec62bbc tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:50.440149 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fcdc921e-8fe9-442c-be8a-92cb3ec62bbc tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:50.440798 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fcdc921e-8fe9-442c-be8a-92cb3ec62bbc tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:50.441907 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fcdc921e-8fe9-442c-be8a-92cb3ec62bbc tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:50.442493 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fcdc921e-8fe9-442c-be8a-92cb3ec62bbc tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:50.655009 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-fcdc921e-8fe9-442c-be8a-92cb3ec62bbc tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:50.663323 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-fcdc921e-8fe9-442c-be8a-92cb3ec62bbc tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1315 microversion: 2.1 time: 0.234804 Jul 31 14:25:50.663841 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 222/450] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:50 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:50.928499 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ee27f88c-52d8-4db3-8e1e-de73b1cc8ad5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:50.929104 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ee27f88c-52d8-4db3-8e1e-de73b1cc8ad5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:50.935182 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ee27f88c-52d8-4db3-8e1e-de73b1cc8ad5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:50.935666 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ee27f88c-52d8-4db3-8e1e-de73b1cc8ad5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:50.936425 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ee27f88c-52d8-4db3-8e1e-de73b1cc8ad5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:50.936864 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ee27f88c-52d8-4db3-8e1e-de73b1cc8ad5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:51.090622 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ee27f88c-52d8-4db3-8e1e-de73b1cc8ad5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:51.098771 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ee27f88c-52d8-4db3-8e1e-de73b1cc8ad5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1372 microversion: 2.1 time: 0.174027 Jul 31 14:25:51.099475 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 229/451] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:50 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:51.439271 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-c1f8937e-f94f-4a10-bbd7-7848e471c27d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:51.440289 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-c1f8937e-f94f-4a10-bbd7-7848e471c27d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:51.447130 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c1f8937e-f94f-4a10-bbd7-7848e471c27d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:51.447616 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c1f8937e-f94f-4a10-bbd7-7848e471c27d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:51.448394 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c1f8937e-f94f-4a10-bbd7-7848e471c27d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:51.448828 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c1f8937e-f94f-4a10-bbd7-7848e471c27d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:51.555636 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-f88f87da-44e0-47fd-a72d-2aa7b95e80b8 req-9348683a-ddc6-4f61-ad1b-ea342e80570c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0810b36-49ee-482b-9e65-f587148b2a81", "name": "network-vif-unplugged", "status": "completed", "tag": "24bdbc3b-fa2f-407d-8ddb-f37abeee2dba"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:25:51.565891 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-f88f87da-44e0-47fd-a72d-2aa7b95e80b8 req-9348683a-ddc6-4f61-ad1b-ea342e80570c service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:51.566767 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-f88f87da-44e0-47fd-a72d-2aa7b95e80b8 req-9348683a-ddc6-4f61-ad1b-ea342e80570c service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:51.578864 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.compute.server_external_events [req-f88f87da-44e0-47fd-a72d-2aa7b95e80b8 req-9348683a-ddc6-4f61-ad1b-ea342e80570c service nova] Unable to find a host for instance d0810b36-49ee-482b-9e65-f587148b2a81. Dropping event network-vif-unplugged {{(pid=117780) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 31 14:25:51.579755 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-f88f87da-44e0-47fd-a72d-2aa7b95e80b8 req-9348683a-ddc6-4f61-ad1b-ea342e80570c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028711 Jul 31 14:25:51.580525 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 230/452] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 31 14:25:51.613359 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c1f8937e-f94f-4a10-bbd7-7848e471c27d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:51.622311 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c1f8937e-f94f-4a10-bbd7-7848e471c27d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:51.623971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c1f8937e-f94f-4a10-bbd7-7848e471c27d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:51.625362 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-c1f8937e-f94f-4a10-bbd7-7848e471c27d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1665 microversion: 2.20 time: 0.189897 Jul 31 14:25:51.626007 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 223/453] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:51 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1665 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:51.647975 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-63d26316-c7ce-4b50-8d2f-f3c9c1b58727 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1905e150-6307-4893-b067-d5cee9922c73"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:25:51.650418 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-63d26316-c7ce-4b50-8d2f-f3c9c1b58727 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:51.656413 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-63d26316-c7ce-4b50-8d2f-f3c9c1b58727 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:51.656853 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-63d26316-c7ce-4b50-8d2f-f3c9c1b58727 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:51.657609 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-63d26316-c7ce-4b50-8d2f-f3c9c1b58727 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:51.658039 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-63d26316-c7ce-4b50-8d2f-f3c9c1b58727 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:51.684224 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-69b21d99-4666-4843-abc4-958536d2a7d9 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:51.684835 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-69b21d99-4666-4843-abc4-958536d2a7d9 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:51.692745 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-69b21d99-4666-4843-abc4-958536d2a7d9 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:51.693271 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-69b21d99-4666-4843-abc4-958536d2a7d9 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:51.693936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-69b21d99-4666-4843-abc4-958536d2a7d9 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:51.694369 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-69b21d99-4666-4843-abc4-958536d2a7d9 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:51.830574 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-69b21d99-4666-4843-abc4-958536d2a7d9 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:51.838795 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-69b21d99-4666-4843-abc4-958536d2a7d9 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1315 microversion: 2.1 time: 0.158388 Jul 31 14:25:51.839362 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 224/454] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:51 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:51.952497 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-63d26316-c7ce-4b50-8d2f-f3c9c1b58727 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "POST /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.308524 Jul 31 14:25:51.953054 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 231/455] 10.222.0.40 () {62 vars in 1364 bytes} [Sun Jul 31 14:25:51 2022] POST /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81/os-volume_attachments => generated 188 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 14:25:52.076580 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-c857f3ab-9608-4760-8d0b-a135ccaad199 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:25:52.077174 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-c857f3ab-9608-4760-8d0b-a135ccaad199 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:52.083020 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c857f3ab-9608-4760-8d0b-a135ccaad199 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:52.083986 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c857f3ab-9608-4760-8d0b-a135ccaad199 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:52.084748 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c857f3ab-9608-4760-8d0b-a135ccaad199 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:52.085189 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c857f3ab-9608-4760-8d0b-a135ccaad199 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:52.119543 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d15df66e-f04d-4cab-b16b-8f8657139692 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:52.120152 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d15df66e-f04d-4cab-b16b-8f8657139692 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:52.127960 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-c857f3ab-9608-4760-8d0b-a135ccaad199 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117781) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 31 14:25:52.131284 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d15df66e-f04d-4cab-b16b-8f8657139692 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:52.131771 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d15df66e-f04d-4cab-b16b-8f8657139692 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:52.132549 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d15df66e-f04d-4cab-b16b-8f8657139692 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:52.133148 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d15df66e-f04d-4cab-b16b-8f8657139692 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:52.214110 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-c857f3ab-9608-4760-8d0b-a135ccaad199 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "POST /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81/action" status: 202 len: 0 microversion: 2.20 time: 0.141803 Jul 31 14:25:52.214760 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 225/456] 10.222.0.40 () {62 vars in 1319 bytes} [Sun Jul 31 14:25:52 2022] POST /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 31 14:25:52.222774 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-129454c7-b53e-43ec-a674-3c798e5ddf13 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:52.223390 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-129454c7-b53e-43ec-a674-3c798e5ddf13 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:52.230856 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-129454c7-b53e-43ec-a674-3c798e5ddf13 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:52.231607 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-129454c7-b53e-43ec-a674-3c798e5ddf13 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:52.233708 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-129454c7-b53e-43ec-a674-3c798e5ddf13 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:52.234327 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-129454c7-b53e-43ec-a674-3c798e5ddf13 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:52.239694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:25:52.323195 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d15df66e-f04d-4cab-b16b-8f8657139692 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:52.331910 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d15df66e-f04d-4cab-b16b-8f8657139692 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1372 microversion: 2.1 time: 0.215898 Jul 31 14:25:52.346152 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 232/457] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:52 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1372 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:52.406653 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-129454c7-b53e-43ec-a674-3c798e5ddf13 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:52.415848 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-129454c7-b53e-43ec-a674-3c798e5ddf13 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:52.417956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-129454c7-b53e-43ec-a674-3c798e5ddf13 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:52.418555 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-129454c7-b53e-43ec-a674-3c798e5ddf13 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1751 microversion: 2.20 time: 0.199478 Jul 31 14:25:52.419110 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 226/458] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:52 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1751 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:52.861342 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b611ffd7-a801-48c1-b7f3-5f4ccd3f247e tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:52.861953 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b611ffd7-a801-48c1-b7f3-5f4ccd3f247e tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:52.872545 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b611ffd7-a801-48c1-b7f3-5f4ccd3f247e tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:52.872988 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b611ffd7-a801-48c1-b7f3-5f4ccd3f247e tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:52.873756 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b611ffd7-a801-48c1-b7f3-5f4ccd3f247e tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:52.874190 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b611ffd7-a801-48c1-b7f3-5f4ccd3f247e tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:53.011009 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b611ffd7-a801-48c1-b7f3-5f4ccd3f247e tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:53.018761 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b611ffd7-a801-48c1-b7f3-5f4ccd3f247e tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1315 microversion: 2.1 time: 0.161222 Jul 31 14:25:53.019329 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 233/459] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:52 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:53.354038 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-0d43f5bc-348d-42db-a939-ab11444a44bb tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:53.354668 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-0d43f5bc-348d-42db-a939-ab11444a44bb tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:53.361041 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0d43f5bc-348d-42db-a939-ab11444a44bb tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:53.361494 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0d43f5bc-348d-42db-a939-ab11444a44bb tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:53.362251 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0d43f5bc-348d-42db-a939-ab11444a44bb tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:53.362687 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0d43f5bc-348d-42db-a939-ab11444a44bb tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:53.441629 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c0a4683b-f6a0-4ee1-90d4-ff0ba1a901ad tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:53.442224 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c0a4683b-f6a0-4ee1-90d4-ff0ba1a901ad tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:53.448644 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c0a4683b-f6a0-4ee1-90d4-ff0ba1a901ad tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:53.449090 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c0a4683b-f6a0-4ee1-90d4-ff0ba1a901ad tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:53.449845 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c0a4683b-f6a0-4ee1-90d4-ff0ba1a901ad tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:53.450533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c0a4683b-f6a0-4ee1-90d4-ff0ba1a901ad tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:53.506478 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-0d43f5bc-348d-42db-a939-ab11444a44bb tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:53.514642 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-0d43f5bc-348d-42db-a939-ab11444a44bb tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1372 microversion: 2.1 time: 0.164305 Jul 31 14:25:53.515461 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 227/460] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:53 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:53.596424 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-cb017e21-5560-40a5-9252-01ba8b581a17 req-544bc55f-a5d6-456a-a8a8-77420a09a37e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337cbeb6-512e-4bf5-bd53-cd837c00947e", "name": "network-vif-plugged", "status": "completed", "tag": "8cbcf7d3-6045-42ae-b5a4-ef6ca863d210"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:25:53.597293 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c0a4683b-f6a0-4ee1-90d4-ff0ba1a901ad tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:53.608447 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-cb017e21-5560-40a5-9252-01ba8b581a17 req-544bc55f-a5d6-456a-a8a8-77420a09a37e service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:53.608989 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-cb017e21-5560-40a5-9252-01ba8b581a17 req-544bc55f-a5d6-456a-a8a8-77420a09a37e service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:53.610899 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c0a4683b-f6a0-4ee1-90d4-ff0ba1a901ad tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:53.613440 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c0a4683b-f6a0-4ee1-90d4-ff0ba1a901ad tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:53.615379 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c0a4683b-f6a0-4ee1-90d4-ff0ba1a901ad tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1751 microversion: 2.20 time: 0.177317 Jul 31 14:25:53.627763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 234/461] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:53 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:53.631699 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-cb017e21-5560-40a5-9252-01ba8b581a17 req-544bc55f-a5d6-456a-a8a8-77420a09a37e service nova] Creating event network-vif-plugged:8cbcf7d3-6045-42ae-b5a4-ef6ca863d210 for instance 337cbeb6-512e-4bf5-bd53-cd837c00947e on hv-cinder-84984 Jul 31 14:25:53.638235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-cb017e21-5560-40a5-9252-01ba8b581a17 req-544bc55f-a5d6-456a-a8a8-77420a09a37e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045394 Jul 31 14:25:53.638890 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 228/462] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:25:54.039000 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f75df4d7-8f64-4925-bd9a-2e0b8213dd44 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:54.039640 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f75df4d7-8f64-4925-bd9a-2e0b8213dd44 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:54.046735 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f75df4d7-8f64-4925-bd9a-2e0b8213dd44 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:54.047379 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f75df4d7-8f64-4925-bd9a-2e0b8213dd44 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:54.048291 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f75df4d7-8f64-4925-bd9a-2e0b8213dd44 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:54.048815 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f75df4d7-8f64-4925-bd9a-2e0b8213dd44 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:54.245046 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f75df4d7-8f64-4925-bd9a-2e0b8213dd44 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:54.248805 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:25:54.253914 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f75df4d7-8f64-4925-bd9a-2e0b8213dd44 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1464 microversion: 2.1 time: 0.218713 Jul 31 14:25:54.254525 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 235/463] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:54 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1464 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:54.301142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-19b90142-2aba-4dcb-a6e8-ba9aeec231ee tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:54.302394 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-19b90142-2aba-4dcb-a6e8-ba9aeec231ee tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:54.309231 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-19b90142-2aba-4dcb-a6e8-ba9aeec231ee tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:54.309687 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-19b90142-2aba-4dcb-a6e8-ba9aeec231ee tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:54.310474 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-19b90142-2aba-4dcb-a6e8-ba9aeec231ee tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:54.311057 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-19b90142-2aba-4dcb-a6e8-ba9aeec231ee tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:54.339065 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-19b90142-2aba-4dcb-a6e8-ba9aeec231ee tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Going to try to terminate instance {{(pid=117781) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 14:25:54.420898 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-19b90142-2aba-4dcb-a6e8-ba9aeec231ee tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "DELETE /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 204 len: 0 microversion: 2.1 time: 0.123819 Jul 31 14:25:54.424860 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 229/464] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:25:54 2022] DELETE /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 14:25:54.431692 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-44439139-6afb-4d1b-96a6-3119c5657c95 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:54.432559 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-44439139-6afb-4d1b-96a6-3119c5657c95 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:54.439329 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-44439139-6afb-4d1b-96a6-3119c5657c95 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:54.439842 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-44439139-6afb-4d1b-96a6-3119c5657c95 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:54.440612 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-44439139-6afb-4d1b-96a6-3119c5657c95 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:54.441053 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-44439139-6afb-4d1b-96a6-3119c5657c95 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:54.537884 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-59fd5b74-945d-4c57-89ec-363ab033bcd2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:54.539043 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-59fd5b74-945d-4c57-89ec-363ab033bcd2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:54.544898 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-59fd5b74-945d-4c57-89ec-363ab033bcd2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:54.545346 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-59fd5b74-945d-4c57-89ec-363ab033bcd2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:54.546147 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-59fd5b74-945d-4c57-89ec-363ab033bcd2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:54.546639 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-59fd5b74-945d-4c57-89ec-363ab033bcd2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:54.572192 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-44439139-6afb-4d1b-96a6-3119c5657c95 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:54.579946 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-44439139-6afb-4d1b-96a6-3119c5657c95 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1470 microversion: 2.1 time: 0.153730 Jul 31 14:25:54.580516 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 236/465] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:54 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:54.639320 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c61e6eba-d897-4c86-a120-0bf0e1152458 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:54.639958 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c61e6eba-d897-4c86-a120-0bf0e1152458 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:54.646589 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c61e6eba-d897-4c86-a120-0bf0e1152458 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:54.647040 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c61e6eba-d897-4c86-a120-0bf0e1152458 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:54.647835 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c61e6eba-d897-4c86-a120-0bf0e1152458 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:54.648272 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c61e6eba-d897-4c86-a120-0bf0e1152458 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:54.691829 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-59fd5b74-945d-4c57-89ec-363ab033bcd2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:54.700729 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-59fd5b74-945d-4c57-89ec-363ab033bcd2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1372 microversion: 2.1 time: 0.167514 Jul 31 14:25:54.701714 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 230/466] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:54 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:54.795823 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c61e6eba-d897-4c86-a120-0bf0e1152458 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:54.806857 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c61e6eba-d897-4c86-a120-0bf0e1152458 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:54.809682 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c61e6eba-d897-4c86-a120-0bf0e1152458 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:54.810850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c61e6eba-d897-4c86-a120-0bf0e1152458 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1753 microversion: 2.20 time: 0.175518 Jul 31 14:25:54.811415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 237/467] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:54 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:25:55.602282 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-393dd826-4e3e-48e2-9479-1934ce6224a9 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:55.602895 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-393dd826-4e3e-48e2-9479-1934ce6224a9 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:55.609375 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-393dd826-4e3e-48e2-9479-1934ce6224a9 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:55.609825 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-393dd826-4e3e-48e2-9479-1934ce6224a9 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:55.610590 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-393dd826-4e3e-48e2-9479-1934ce6224a9 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:55.611031 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-393dd826-4e3e-48e2-9479-1934ce6224a9 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:55.722830 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-30e01718-2e1b-4ae0-816e-096cee1e82fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:55.723359 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-30e01718-2e1b-4ae0-816e-096cee1e82fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:55.730451 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-30e01718-2e1b-4ae0-816e-096cee1e82fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:55.730898 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-30e01718-2e1b-4ae0-816e-096cee1e82fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:55.731699 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-30e01718-2e1b-4ae0-816e-096cee1e82fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:55.732142 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-30e01718-2e1b-4ae0-816e-096cee1e82fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:55.737946 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-393dd826-4e3e-48e2-9479-1934ce6224a9 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:55.745398 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-393dd826-4e3e-48e2-9479-1934ce6224a9 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1470 microversion: 2.1 time: 0.147460 Jul 31 14:25:55.745970 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 231/468] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:55 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:55.834560 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-df66c6f5-1400-4478-b1d1-7431c6795574 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:55.835225 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-df66c6f5-1400-4478-b1d1-7431c6795574 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:55.841167 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-df66c6f5-1400-4478-b1d1-7431c6795574 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:55.841620 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-df66c6f5-1400-4478-b1d1-7431c6795574 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:55.842394 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-df66c6f5-1400-4478-b1d1-7431c6795574 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:55.842833 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-df66c6f5-1400-4478-b1d1-7431c6795574 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:55.861753 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-30e01718-2e1b-4ae0-816e-096cee1e82fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:55.869134 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-30e01718-2e1b-4ae0-816e-096cee1e82fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1372 microversion: 2.1 time: 0.150429 Jul 31 14:25:55.869721 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 238/469] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:55 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:55.968712 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-df66c6f5-1400-4478-b1d1-7431c6795574 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:55.977874 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-df66c6f5-1400-4478-b1d1-7431c6795574 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:55.979324 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-df66c6f5-1400-4478-b1d1-7431c6795574 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:55.980506 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-df66c6f5-1400-4478-b1d1-7431c6795574 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1753 microversion: 2.20 time: 0.150348 Jul 31 14:25:55.981072 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 232/470] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:55 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:25:56.766178 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7db2b0e7-8cdf-445d-b8f4-767420aac96c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:56.766788 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7db2b0e7-8cdf-445d-b8f4-767420aac96c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:56.773793 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7db2b0e7-8cdf-445d-b8f4-767420aac96c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:56.774242 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7db2b0e7-8cdf-445d-b8f4-767420aac96c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:56.775003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7db2b0e7-8cdf-445d-b8f4-767420aac96c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:56.775462 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7db2b0e7-8cdf-445d-b8f4-767420aac96c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:56.889751 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-dda5d07f-8661-4b98-a940-bc4c2d00d1d8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:56.890352 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-dda5d07f-8661-4b98-a940-bc4c2d00d1d8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:56.897403 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dda5d07f-8661-4b98-a940-bc4c2d00d1d8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:56.897848 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dda5d07f-8661-4b98-a940-bc4c2d00d1d8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:56.898604 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dda5d07f-8661-4b98-a940-bc4c2d00d1d8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:56.899043 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dda5d07f-8661-4b98-a940-bc4c2d00d1d8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:56.918503 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7db2b0e7-8cdf-445d-b8f4-767420aac96c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:56.927343 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7db2b0e7-8cdf-445d-b8f4-767420aac96c tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1470 microversion: 2.1 time: 0.164916 Jul 31 14:25:56.928233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 239/471] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:56 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:57.004056 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-25c6836e-3e6b-4b81-9217-576b448b4513 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:57.004745 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-25c6836e-3e6b-4b81-9217-576b448b4513 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:57.011878 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-25c6836e-3e6b-4b81-9217-576b448b4513 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:57.012425 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-25c6836e-3e6b-4b81-9217-576b448b4513 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:57.013278 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-25c6836e-3e6b-4b81-9217-576b448b4513 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:57.013793 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-25c6836e-3e6b-4b81-9217-576b448b4513 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:57.154650 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-25c6836e-3e6b-4b81-9217-576b448b4513 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:57.163789 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-25c6836e-3e6b-4b81-9217-576b448b4513 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:57.165336 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-25c6836e-3e6b-4b81-9217-576b448b4513 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:57.166505 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-25c6836e-3e6b-4b81-9217-576b448b4513 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1753 microversion: 2.20 time: 0.166508 Jul 31 14:25:57.167075 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 240/472] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:56 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:25:57.295362 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-dda5d07f-8661-4b98-a940-bc4c2d00d1d8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:57.303220 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-dda5d07f-8661-4b98-a940-bc4c2d00d1d8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1372 microversion: 2.1 time: 0.417421 Jul 31 14:25:57.303829 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 233/473] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:56 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1372 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:25:57.947737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e1dbb95e-be31-451b-8006-415962fd2d3b tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:57.948327 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e1dbb95e-be31-451b-8006-415962fd2d3b tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:57.955087 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e1dbb95e-be31-451b-8006-415962fd2d3b tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:57.955567 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e1dbb95e-be31-451b-8006-415962fd2d3b tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:57.956319 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e1dbb95e-be31-451b-8006-415962fd2d3b tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:57.956747 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e1dbb95e-be31-451b-8006-415962fd2d3b tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:58.088800 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e1dbb95e-be31-451b-8006-415962fd2d3b tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:58.098116 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e1dbb95e-be31-451b-8006-415962fd2d3b tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1470 microversion: 2.1 time: 0.154215 Jul 31 14:25:58.100081 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 241/474] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:57 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:58.192264 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-91f863ff-8b95-4114-819b-0815f81478aa tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:58.192875 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-91f863ff-8b95-4114-819b-0815f81478aa tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:58.199441 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-91f863ff-8b95-4114-819b-0815f81478aa tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:58.199893 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-91f863ff-8b95-4114-819b-0815f81478aa tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:58.200946 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-91f863ff-8b95-4114-819b-0815f81478aa tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:58.201382 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-91f863ff-8b95-4114-819b-0815f81478aa tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:58.331550 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0f326c30-12d7-4b15-a847-25e305ff5754 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:58.332152 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0f326c30-12d7-4b15-a847-25e305ff5754 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:58.344707 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0f326c30-12d7-4b15-a847-25e305ff5754 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:58.345077 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0f326c30-12d7-4b15-a847-25e305ff5754 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:58.345839 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0f326c30-12d7-4b15-a847-25e305ff5754 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:58.346271 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0f326c30-12d7-4b15-a847-25e305ff5754 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:58.396961 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-91f863ff-8b95-4114-819b-0815f81478aa tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:58.406070 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-91f863ff-8b95-4114-819b-0815f81478aa tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:58.407752 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-91f863ff-8b95-4114-819b-0815f81478aa tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:58.409004 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-91f863ff-8b95-4114-819b-0815f81478aa tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1809 microversion: 2.20 time: 0.222109 Jul 31 14:25:58.409638 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 234/475] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:58 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:58.482364 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0f326c30-12d7-4b15-a847-25e305ff5754 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:58.490089 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0f326c30-12d7-4b15-a847-25e305ff5754 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1565 microversion: 2.1 time: 0.162936 Jul 31 14:25:58.490659 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 242/476] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:58 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:58.511550 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-fbf499ae-a664-4ff4-b149-95a19ea5cf9b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:58.512045 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-fbf499ae-a664-4ff4-b149-95a19ea5cf9b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:58.518492 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fbf499ae-a664-4ff4-b149-95a19ea5cf9b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:58.518939 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fbf499ae-a664-4ff4-b149-95a19ea5cf9b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:58.519732 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fbf499ae-a664-4ff4-b149-95a19ea5cf9b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:58.520168 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fbf499ae-a664-4ff4-b149-95a19ea5cf9b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:58.667198 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-dad5a22f-4f55-43fe-8ab5-7c1302b28176 req-b9ba9206-700f-4561-be53-b1ee8856c91e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60", "name": "network-vif-deleted", "tag": "8d6613a4-de2a-4912-9a33-a4914a893c16"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:25:58.678697 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-dad5a22f-4f55-43fe-8ab5-7c1302b28176 req-b9ba9206-700f-4561-be53-b1ee8856c91e service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:58.679041 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-dad5a22f-4f55-43fe-8ab5-7c1302b28176 req-b9ba9206-700f-4561-be53-b1ee8856c91e service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:58.681036 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-fbf499ae-a664-4ff4-b149-95a19ea5cf9b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.173301 Jul 31 14:25:58.683521 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 235/477] 10.222.0.40 () {58 vars in 1275 bytes} [Sun Jul 31 14:25:58 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:25:58.691369 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-dad5a22f-4f55-43fe-8ab5-7c1302b28176 req-b9ba9206-700f-4561-be53-b1ee8856c91e service nova] Creating event network-vif-deleted:8d6613a4-de2a-4912-9a33-a4914a893c16 for instance 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 on hv-cinder-84984 Jul 31 14:25:58.697763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-dad5a22f-4f55-43fe-8ab5-7c1302b28176 req-b9ba9206-700f-4561-be53-b1ee8856c91e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034256 Jul 31 14:25:58.701681 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 243/478] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:25:59.120648 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-9136a23d-32b0-425b-b509-c0a87780b4a4 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:59.121266 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-9136a23d-32b0-425b-b509-c0a87780b4a4 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:59.127484 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9136a23d-32b0-425b-b509-c0a87780b4a4 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:59.127940 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9136a23d-32b0-425b-b509-c0a87780b4a4 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:59.128718 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9136a23d-32b0-425b-b509-c0a87780b4a4 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:59.129156 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9136a23d-32b0-425b-b509-c0a87780b4a4 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:59.161263 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9136a23d-32b0-425b-b509-c0a87780b4a4 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:59.161713 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9136a23d-32b0-425b-b509-c0a87780b4a4 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:59.162172 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.objects.instance [None req-9136a23d-32b0-425b-b509-c0a87780b4a4 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lazy-loading 'fault' on Instance uuid 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 {{(pid=117781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:25:59.206681 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-9136a23d-32b0-425b-b509-c0a87780b4a4 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d1952d79174b6596f829cd85ca690b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ad86716ddf412f91a1128ba7159585', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:59.215453 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-9136a23d-32b0-425b-b509-c0a87780b4a4 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 200 len: 1305 microversion: 2.1 time: 0.098755 Jul 31 14:25:59.216061 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 236/479] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:25:59 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:25:59.435485 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9d26002e-fdbe-4a62-aaba-54bb86a6f30d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:25:59.436903 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9d26002e-fdbe-4a62-aaba-54bb86a6f30d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:25:59.444818 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9d26002e-fdbe-4a62-aaba-54bb86a6f30d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:59.445301 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9d26002e-fdbe-4a62-aaba-54bb86a6f30d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:59.446268 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9d26002e-fdbe-4a62-aaba-54bb86a6f30d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:25:59.446714 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9d26002e-fdbe-4a62-aaba-54bb86a6f30d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:25:59.889502 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9d26002e-fdbe-4a62-aaba-54bb86a6f30d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:59.898468 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9d26002e-fdbe-4a62-aaba-54bb86a6f30d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:59.900006 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9d26002e-fdbe-4a62-aaba-54bb86a6f30d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:25:59.901153 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9d26002e-fdbe-4a62-aaba-54bb86a6f30d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1809 microversion: 2.20 time: 0.470955 Jul 31 14:25:59.901897 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 244/480] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:25:59 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1809 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:25:59.996646 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-4240964c-a221-4516-b689-dae5249cb199 req-e458b7cb-3dee-4f4f-b785-598d8ecc213e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337cbeb6-512e-4bf5-bd53-cd837c00947e", "tag": "8cbcf7d3-6045-42ae-b5a4-ef6ca863d210"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:26:00.006798 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-4240964c-a221-4516-b689-dae5249cb199 req-e458b7cb-3dee-4f4f-b785-598d8ecc213e service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:00.007405 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-4240964c-a221-4516-b689-dae5249cb199 req-e458b7cb-3dee-4f4f-b785-598d8ecc213e service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:00.018995 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-4240964c-a221-4516-b689-dae5249cb199 req-e458b7cb-3dee-4f4f-b785-598d8ecc213e service nova] Creating event network-changed:8cbcf7d3-6045-42ae-b5a4-ef6ca863d210 for instance 337cbeb6-512e-4bf5-bd53-cd837c00947e on hv-cinder-84984 Jul 31 14:26:00.024849 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-4240964c-a221-4516-b689-dae5249cb199 req-e458b7cb-3dee-4f4f-b785-598d8ecc213e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033514 Jul 31 14:26:00.025521 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 237/481] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:26:00.237258 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1d7181e5-ac42-48dc-b10d-566c539d9ac8 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:00.238139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1d7181e5-ac42-48dc-b10d-566c539d9ac8 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] [instance: 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:00.247214 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d7181e5-ac42-48dc-b10d-566c539d9ac8 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:00.247677 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d7181e5-ac42-48dc-b10d-566c539d9ac8 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:00.251185 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d7181e5-ac42-48dc-b10d-566c539d9ac8 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:00.254461 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d7181e5-ac42-48dc-b10d-566c539d9ac8 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:00.283617 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-1d7181e5-ac42-48dc-b10d-566c539d9ac8 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] HTTP exception thrown: Instance 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 could not be found. Jul 31 14:26:00.285746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1d7181e5-ac42-48dc-b10d-566c539d9ac8 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Request method failure captured: Jul 31 14:26:00.285746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 HTTP/1.1 Jul 31 14:26:00.285746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:26:00.285746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:26:00.285746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:26:00.285746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:26:00.285746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:26:00.285746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:26:00.285746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:26:00.285746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:26:00.285746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pDSrebHR6T74BmytISa-IFG15U0mv5TjWuy_VqplGV5jGylYRO-B5Sy-5ImPtVrV8nI8WZVl0UJukOmbJKDTB3Jgs0hhZqsiBzlZtIiwSD-1TatGUgEzMOzM_2MsH_ONGkIWbZeFXqjO5qNMqcNpHDJUlat5Cov67QOsw3jI6FHBUc Jul 31 14:26:00.285746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:26:00.285746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:26:00.285746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:26:00.285746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:26:00.285746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:26:00.285746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:26:00.285746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: b0ad86716ddf412f91a1128ba7159585 Jul 31 14:26:00.285746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-VolumesNegativeTest-806959890 Jul 31 14:26:00.285746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:26:00.285746 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:26:00.287982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b0ad86716ddf412f91a1128ba7159585"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_b0ad86716ddf412f91a1128ba7159585", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/b0ad86716ddf412f91a1128ba7159585"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/b0ad86716ddf412f91a1128ba7159585"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:26:00.287982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-VolumesNegativeTest-806959890 Jul 31 14:26:00.287982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: b0ad86716ddf412f91a1128ba7159585 Jul 31 14:26:00.287982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-VolumesNegativeTest-806959890 Jul 31 14:26:00.287982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-VolumesNegativeTest-806959890-project Jul 31 14:26:00.287982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:26:00.287982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:26:00.287982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: b6d1952d79174b6596f829cd85ca690b Jul 31 14:26:00.287982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-VolumesNegativeTest-806959890-project Jul 31 14:26:00.287982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:26:00.287982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 could not be found. Jul 31 14:26:00.287982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': '4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60'} Jul 31 14:26:00.288890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:26:00.288890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:26:00.288890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:26:00.288890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:26:00.288890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:26:00.288890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:26:00.288890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:26:00.288890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:26:00.288890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:26:00.288890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:26:00.288890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 could not be found. Jul 31 14:26:00.288890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:26:00.288890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:26:00.288890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:26:00.288890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:26:00.288890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:26:00.288890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:26:00.288890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:26:00.288890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:26:00.288890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:26:00.290304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:26:00.290304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:26:00.290304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:26:00.290304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:26:00.290304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:26:00.290304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:26:00.290304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:26:00.290304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 could not be found. Jul 31 14:26:00.290304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:26:00.290304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:26:00.290304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:26:00.290304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:26:00.290304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:26:00.290304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:26:00.290304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:26:00.290304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:26:00.290304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 could not be found. Jul 31 14:26:00.290304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:26:00.292648 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1d7181e5-ac42-48dc-b10d-566c539d9ac8 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] Returning 404 to user: Instance 4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:26:00.293763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1d7181e5-ac42-48dc-b10d-566c539d9ac8 tempest-VolumesNegativeTest-806959890 tempest-VolumesNegativeTest-806959890-project] 10.222.0.40 "GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60" status: 404 len: 111 microversion: 2.1 time: 0.060548 Jul 31 14:26:00.294908 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 245/482] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:00 2022] GET /compute/v2.1/servers/4b7d9ebc-8cf3-46bc-bc66-bc58fd53ee60 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:26:00.932553 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-578f4605-d3af-466e-9654-373ff7cda7da tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:00.933250 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-578f4605-d3af-466e-9654-373ff7cda7da tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:00.939937 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-578f4605-d3af-466e-9654-373ff7cda7da tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:00.940685 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-578f4605-d3af-466e-9654-373ff7cda7da tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:00.941651 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-578f4605-d3af-466e-9654-373ff7cda7da tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:00.942294 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-578f4605-d3af-466e-9654-373ff7cda7da tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:01.201377 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-578f4605-d3af-466e-9654-373ff7cda7da tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:01.211756 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-578f4605-d3af-466e-9654-373ff7cda7da tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:01.213514 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-578f4605-d3af-466e-9654-373ff7cda7da tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:01.214870 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-578f4605-d3af-466e-9654-373ff7cda7da tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1809 microversion: 2.20 time: 0.290759 Jul 31 14:26:01.228097 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 238/483] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:26:00 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1809 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:26:02.239166 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-036a18fb-e38d-4aa3-b9cc-d2963d66fca9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:02.239920 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-036a18fb-e38d-4aa3-b9cc-d2963d66fca9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:02.242755 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=87 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:26:02.247933 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-036a18fb-e38d-4aa3-b9cc-d2963d66fca9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:02.248455 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-036a18fb-e38d-4aa3-b9cc-d2963d66fca9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:02.249160 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-036a18fb-e38d-4aa3-b9cc-d2963d66fca9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:02.249594 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-036a18fb-e38d-4aa3-b9cc-d2963d66fca9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:02.418066 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-036a18fb-e38d-4aa3-b9cc-d2963d66fca9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:02.449276 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-036a18fb-e38d-4aa3-b9cc-d2963d66fca9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:02.451044 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-036a18fb-e38d-4aa3-b9cc-d2963d66fca9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:02.452239 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-036a18fb-e38d-4aa3-b9cc-d2963d66fca9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1809 microversion: 2.20 time: 0.217074 Jul 31 14:26:02.452780 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 246/484] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:26:02 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:26:03.478642 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-ef23a553-0fae-4e0e-9682-6ba789c93017 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:03.479232 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-ef23a553-0fae-4e0e-9682-6ba789c93017 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:03.485667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ef23a553-0fae-4e0e-9682-6ba789c93017 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:03.486117 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ef23a553-0fae-4e0e-9682-6ba789c93017 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:03.486984 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ef23a553-0fae-4e0e-9682-6ba789c93017 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:03.487542 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ef23a553-0fae-4e0e-9682-6ba789c93017 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:03.634241 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-ef23a553-0fae-4e0e-9682-6ba789c93017 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:03.646147 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-ef23a553-0fae-4e0e-9682-6ba789c93017 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:03.647884 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-ef23a553-0fae-4e0e-9682-6ba789c93017 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:03.649845 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-ef23a553-0fae-4e0e-9682-6ba789c93017 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1809 microversion: 2.20 time: 0.176333 Jul 31 14:26:03.650905 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 239/485] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:26:03 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:26:04.673952 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-cab1a204-ed44-4138-b7ca-3a0515673b99 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:04.675185 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-cab1a204-ed44-4138-b7ca-3a0515673b99 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:04.689472 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cab1a204-ed44-4138-b7ca-3a0515673b99 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:04.689921 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cab1a204-ed44-4138-b7ca-3a0515673b99 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:04.690700 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cab1a204-ed44-4138-b7ca-3a0515673b99 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:04.691134 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cab1a204-ed44-4138-b7ca-3a0515673b99 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:04.858508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-cab1a204-ed44-4138-b7ca-3a0515673b99 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:04.867603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-cab1a204-ed44-4138-b7ca-3a0515673b99 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:04.869405 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-cab1a204-ed44-4138-b7ca-3a0515673b99 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:04.870574 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-cab1a204-ed44-4138-b7ca-3a0515673b99 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1809 microversion: 2.20 time: 0.200488 Jul 31 14:26:04.875956 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 247/486] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:26:04 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:26:05.901222 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-05314793-d834-45c8-b97f-32be9a2d4948 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:05.902800 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-05314793-d834-45c8-b97f-32be9a2d4948 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:05.909381 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-05314793-d834-45c8-b97f-32be9a2d4948 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:05.909898 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-05314793-d834-45c8-b97f-32be9a2d4948 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:05.910675 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-05314793-d834-45c8-b97f-32be9a2d4948 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:05.911227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-05314793-d834-45c8-b97f-32be9a2d4948 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:06.150656 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-05314793-d834-45c8-b97f-32be9a2d4948 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:06.160811 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-05314793-d834-45c8-b97f-32be9a2d4948 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:06.162677 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-05314793-d834-45c8-b97f-32be9a2d4948 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:06.164175 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-05314793-d834-45c8-b97f-32be9a2d4948 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1809 microversion: 2.20 time: 0.273334 Jul 31 14:26:06.180720 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 240/487] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:26:05 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1809 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:26:07.188466 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1a5d5b2e-8334-49eb-8984-eea3c3c2e7d4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:07.189282 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1a5d5b2e-8334-49eb-8984-eea3c3c2e7d4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:07.202124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1a5d5b2e-8334-49eb-8984-eea3c3c2e7d4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:07.202573 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1a5d5b2e-8334-49eb-8984-eea3c3c2e7d4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:07.203377 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1a5d5b2e-8334-49eb-8984-eea3c3c2e7d4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:07.203826 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1a5d5b2e-8334-49eb-8984-eea3c3c2e7d4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:07.386104 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1a5d5b2e-8334-49eb-8984-eea3c3c2e7d4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:07.398293 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1a5d5b2e-8334-49eb-8984-eea3c3c2e7d4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:07.401185 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1a5d5b2e-8334-49eb-8984-eea3c3c2e7d4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:07.403396 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1a5d5b2e-8334-49eb-8984-eea3c3c2e7d4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1809 microversion: 2.20 time: 0.218590 Jul 31 14:26:07.417152 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 248/488] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:26:07 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:26:08.442756 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-dfd77bd0-dd11-4232-9b5b-53044b7348d2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:08.444389 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-dfd77bd0-dd11-4232-9b5b-53044b7348d2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:08.461082 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dfd77bd0-dd11-4232-9b5b-53044b7348d2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:08.461552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dfd77bd0-dd11-4232-9b5b-53044b7348d2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:08.462532 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dfd77bd0-dd11-4232-9b5b-53044b7348d2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:08.462979 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dfd77bd0-dd11-4232-9b5b-53044b7348d2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:08.838339 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-dfd77bd0-dd11-4232-9b5b-53044b7348d2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:08.848880 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-dfd77bd0-dd11-4232-9b5b-53044b7348d2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:08.851014 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-dfd77bd0-dd11-4232-9b5b-53044b7348d2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:08.853759 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-dfd77bd0-dd11-4232-9b5b-53044b7348d2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1809 microversion: 2.20 time: 0.417480 Jul 31 14:26:08.854480 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 241/489] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:26:08 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1809 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:26:09.877696 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6dd5d54a-b4d5-48ba-bed0-3faff1b5e7fa tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:09.878920 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6dd5d54a-b4d5-48ba-bed0-3faff1b5e7fa tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:09.891395 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6dd5d54a-b4d5-48ba-bed0-3faff1b5e7fa tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:09.891976 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6dd5d54a-b4d5-48ba-bed0-3faff1b5e7fa tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:09.893631 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6dd5d54a-b4d5-48ba-bed0-3faff1b5e7fa tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:09.895645 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6dd5d54a-b4d5-48ba-bed0-3faff1b5e7fa tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:10.090528 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6dd5d54a-b4d5-48ba-bed0-3faff1b5e7fa tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:10.101505 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6dd5d54a-b4d5-48ba-bed0-3faff1b5e7fa tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:10.103190 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6dd5d54a-b4d5-48ba-bed0-3faff1b5e7fa tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:10.108056 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6dd5d54a-b4d5-48ba-bed0-3faff1b5e7fa tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1809 microversion: 2.20 time: 0.234289 Jul 31 14:26:10.123527 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 249/490] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:26:09 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1809 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:26:11.136286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-ad911f85-b2d5-4c31-b179-9539b0175fff tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:11.136977 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-ad911f85-b2d5-4c31-b179-9539b0175fff tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:11.149764 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:26:11.151537 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ad911f85-b2d5-4c31-b179-9539b0175fff tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:11.152071 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ad911f85-b2d5-4c31-b179-9539b0175fff tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:11.153295 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ad911f85-b2d5-4c31-b179-9539b0175fff tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:11.153674 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ad911f85-b2d5-4c31-b179-9539b0175fff tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:11.177341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:26:11.315854 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-ad911f85-b2d5-4c31-b179-9539b0175fff tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:11.328062 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-ad911f85-b2d5-4c31-b179-9539b0175fff tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:11.329818 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-ad911f85-b2d5-4c31-b179-9539b0175fff tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:11.331207 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-ad911f85-b2d5-4c31-b179-9539b0175fff tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1809 microversion: 2.20 time: 0.198848 Jul 31 14:26:11.331820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 242/491] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:26:11 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:26:12.354842 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-cfbbbabc-375d-4a44-a7f9-150f637bdf33 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:12.356083 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-cfbbbabc-375d-4a44-a7f9-150f637bdf33 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:12.362452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cfbbbabc-375d-4a44-a7f9-150f637bdf33 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:12.363134 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cfbbbabc-375d-4a44-a7f9-150f637bdf33 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:12.363992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cfbbbabc-375d-4a44-a7f9-150f637bdf33 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:12.364593 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cfbbbabc-375d-4a44-a7f9-150f637bdf33 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:12.606749 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-cfbbbabc-375d-4a44-a7f9-150f637bdf33 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:12.616227 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-cfbbbabc-375d-4a44-a7f9-150f637bdf33 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:12.619721 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-cfbbbabc-375d-4a44-a7f9-150f637bdf33 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:12.621395 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-cfbbbabc-375d-4a44-a7f9-150f637bdf33 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1809 microversion: 2.20 time: 0.270580 Jul 31 14:26:12.633991 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 250/492] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:26:12 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1809 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:26:13.651939 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7ad15c5e-b80f-47cf-a961-99eab6ee960e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:13.654398 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7ad15c5e-b80f-47cf-a961-99eab6ee960e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:13.661619 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7ad15c5e-b80f-47cf-a961-99eab6ee960e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:13.662078 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7ad15c5e-b80f-47cf-a961-99eab6ee960e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:13.662842 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7ad15c5e-b80f-47cf-a961-99eab6ee960e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:13.663273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7ad15c5e-b80f-47cf-a961-99eab6ee960e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:13.858977 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7ad15c5e-b80f-47cf-a961-99eab6ee960e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:13.868876 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7ad15c5e-b80f-47cf-a961-99eab6ee960e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:13.870388 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7ad15c5e-b80f-47cf-a961-99eab6ee960e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:13.881268 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7ad15c5e-b80f-47cf-a961-99eab6ee960e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1809 microversion: 2.20 time: 0.236752 Jul 31 14:26:13.891534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 243/493] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:26:13 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:26:14.909429 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6643a64d-0956-4fd9-b9b2-6329fdd21565 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:14.912459 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6643a64d-0956-4fd9-b9b2-6329fdd21565 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:14.921342 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6643a64d-0956-4fd9-b9b2-6329fdd21565 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:14.922124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6643a64d-0956-4fd9-b9b2-6329fdd21565 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:14.923121 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6643a64d-0956-4fd9-b9b2-6329fdd21565 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:14.923832 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6643a64d-0956-4fd9-b9b2-6329fdd21565 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:15.108060 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6643a64d-0956-4fd9-b9b2-6329fdd21565 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:15.118521 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6643a64d-0956-4fd9-b9b2-6329fdd21565 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:15.129216 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6643a64d-0956-4fd9-b9b2-6329fdd21565 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:15.131957 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6643a64d-0956-4fd9-b9b2-6329fdd21565 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1809 microversion: 2.20 time: 0.225739 Jul 31 14:26:15.132558 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 251/494] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:26:14 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1809 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:26:16.157444 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-66344ba8-c796-44ff-9a38-31cdda9a7c89 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:16.158059 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-66344ba8-c796-44ff-9a38-31cdda9a7c89 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:16.166771 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-66344ba8-c796-44ff-9a38-31cdda9a7c89 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:16.167493 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-66344ba8-c796-44ff-9a38-31cdda9a7c89 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:16.168439 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-66344ba8-c796-44ff-9a38-31cdda9a7c89 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:16.169028 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-66344ba8-c796-44ff-9a38-31cdda9a7c89 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:16.344322 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-66344ba8-c796-44ff-9a38-31cdda9a7c89 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:16.354573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-66344ba8-c796-44ff-9a38-31cdda9a7c89 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:16.356355 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-66344ba8-c796-44ff-9a38-31cdda9a7c89 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:16.357821 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-66344ba8-c796-44ff-9a38-31cdda9a7c89 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1809 microversion: 2.20 time: 0.206134 Jul 31 14:26:16.372230 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 244/495] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:26:16 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:26:17.383052 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-169a71e2-b3ef-42c0-9ac8-fac875f15e92 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:17.384461 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-169a71e2-b3ef-42c0-9ac8-fac875f15e92 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:17.392800 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-169a71e2-b3ef-42c0-9ac8-fac875f15e92 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:17.393526 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-169a71e2-b3ef-42c0-9ac8-fac875f15e92 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:17.394473 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-169a71e2-b3ef-42c0-9ac8-fac875f15e92 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:17.394977 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-169a71e2-b3ef-42c0-9ac8-fac875f15e92 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:17.583561 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-169a71e2-b3ef-42c0-9ac8-fac875f15e92 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:17.595148 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-169a71e2-b3ef-42c0-9ac8-fac875f15e92 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:17.596655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-169a71e2-b3ef-42c0-9ac8-fac875f15e92 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:17.597918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-169a71e2-b3ef-42c0-9ac8-fac875f15e92 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1809 microversion: 2.20 time: 0.219602 Jul 31 14:26:17.599322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 252/496] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:26:17 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:26:18.250876 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-6c5e3790-9032-40d4-9981-faa9c5b1d78a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:18.252088 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-6c5e3790-9032-40d4-9981-faa9c5b1d78a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:18.258934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6c5e3790-9032-40d4-9981-faa9c5b1d78a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:18.259744 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6c5e3790-9032-40d4-9981-faa9c5b1d78a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:18.261368 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6c5e3790-9032-40d4-9981-faa9c5b1d78a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:18.262008 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6c5e3790-9032-40d4-9981-faa9c5b1d78a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:18.290736 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-6c5e3790-9032-40d4-9981-faa9c5b1d78a tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3/ips" status: 200 len: 150 microversion: 2.1 time: 0.044836 Jul 31 14:26:18.292662 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 245/497] 10.222.0.40 () {58 vars in 1248 bytes} [Sun Jul 31 14:26:18 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:26:18.304165 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b6211028-297f-40db-a517-5b7776d2c747 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b54d681e-8d1b-4645-827c-e1e2122ae289"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:26:18.306550 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b6211028-297f-40db-a517-5b7776d2c747 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:18.312946 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b6211028-297f-40db-a517-5b7776d2c747 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:18.313547 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b6211028-297f-40db-a517-5b7776d2c747 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:18.314568 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b6211028-297f-40db-a517-5b7776d2c747 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:18.315010 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b6211028-297f-40db-a517-5b7776d2c747 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:18.417102 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=100 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:26:18.421252 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-b6211028-297f-40db-a517-5b7776d2c747 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] HTTP exception thrown: Invalid volume: volume b54d681e-8d1b-4645-827c-e1e2122ae289 is already attached to instances: e4f24854-1bcd-405b-9af8-fd3f3967d16b Jul 31 14:26:18.431211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b6211028-297f-40db-a517-5b7776d2c747 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Request method failure captured: Jul 31 14:26:18.431211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: POST /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3/os-volume_attachments HTTP/1.1 Jul 31 14:26:18.431211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:26:18.431211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:26:18.431211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:26:18.431211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 74 Jul 31 14:26:18.431211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:26:18.431211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:26:18.431211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:26:18.431211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:26:18.431211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pA3RnV2a-dDWWL-_ZfxXcr4UktgQI-9SWPGN4xUIh3gpaTPpUlCMNWU1g96nJfR_a1KYUrPG43SkpeWWkH3LXQwcjtBN7d_0kQ02fiRqueKY6XZVQNh8gR0_ddCj_gKuHBtsN430P5RXgDqCVuPQ_rcT-N1y6dWBKzFpQGKjlxkqC0 Jul 31 14:26:18.431211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:26:18.431211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:26:18.431211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:26:18.431211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:26:18.431211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:26:18.431211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:26:18.431211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:26:18.431211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:26:18.431211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:26:18.431211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:26:18.432861 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9097fd66951e457ba46812ff17db7501", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9097fd66951e457ba46812ff17db7501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:26:18.432861 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:26:18.432861 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:26:18.432861 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:26:18.432861 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:26:18.432861 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:26:18.432861 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:26:18.432861 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: d6e8399080a942f1b689fc8c6b42c717 Jul 31 14:26:18.432861 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:26:18.432861 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Jul 31 14:26:18.432861 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {"volumeAttachment": {"volumeId": "b54d681e-8d1b-4645-827c-e1e2122ae289"}} Jul 31 14:26:18.432861 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:26:18.433618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Invalid volume: volume b54d681e-8d1b-4645-827c-e1e2122ae289 is already attached to instances: e4f24854-1bcd-405b-9af8-fd3f3967d16b Jul 31 14:26:18.433618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'server_id': 'ed5b3d28-2f47-4309-a909-0210c782aad3', 'body': {'volumeAttachment': {'volumeId': 'b54d681e-8d1b-4645-827c-e1e2122ae289'}}} Jul 31 14:26:18.433618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:26:18.433618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:26:18.433618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 31 14:26:18.433618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 31 14:26:18.433618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 14:26:18.433618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 14:26:18.433618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 31 14:26:18.433618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 14:26:18.433618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 31 14:26:18.433618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 31 14:26:18.433618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 31 14:26:18.433618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 31 14:26:18.433618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b54d681e-8d1b-4645-827c-e1e2122ae289 is already attached to instances: e4f24854-1bcd-405b-9af8-fd3f3967d16b Jul 31 14:26:18.433618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:26:18.433618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:26:18.433618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:26:18.433618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:26:18.435597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:26:18.435597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:26:18.435597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:26:18.435597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:26:18.435597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:26:18.435597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:26:18.435597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 14:26:18.435597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 14:26:18.435597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 14:26:18.435597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 14:26:18.435597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 14:26:18.435597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 14:26:18.435597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 31 14:26:18.435597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 31 14:26:18.435597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b54d681e-8d1b-4645-827c-e1e2122ae289 is already attached to instances: e4f24854-1bcd-405b-9af8-fd3f3967d16b Jul 31 14:26:18.435597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:26:18.435597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:26:18.435597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:26:18.435597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:26:18.435597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:26:18.438322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:26:18.438322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:26:18.438322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:26:18.438322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b54d681e-8d1b-4645-827c-e1e2122ae289 is already attached to instances: e4f24854-1bcd-405b-9af8-fd3f3967d16b Jul 31 14:26:18.438322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:26:18.438322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b6211028-297f-40db-a517-5b7776d2c747 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Returning 400 to user: Invalid volume: volume b54d681e-8d1b-4645-827c-e1e2122ae289 is already attached to instances: e4f24854-1bcd-405b-9af8-fd3f3967d16b {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:26:18.438322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b6211028-297f-40db-a517-5b7776d2c747 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "POST /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.133191 Jul 31 14:26:18.439992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 253/498] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Jul 31 14:26:18 2022] POST /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3/os-volume_attachments => generated 174 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 14:26:18.444304 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-2fd4a80e-e220-42df-819e-4bf7481e4861 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:18.445339 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-2fd4a80e-e220-42df-819e-4bf7481e4861 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:18.452365 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2fd4a80e-e220-42df-819e-4bf7481e4861 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:18.452826 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2fd4a80e-e220-42df-819e-4bf7481e4861 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:18.453591 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2fd4a80e-e220-42df-819e-4bf7481e4861 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:18.454025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2fd4a80e-e220-42df-819e-4bf7481e4861 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:18.504230 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-2fd4a80e-e220-42df-819e-4bf7481e4861 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Going to try to terminate instance {{(pid=117781) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 14:26:18.605320 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-2fd4a80e-e220-42df-819e-4bf7481e4861 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 204 len: 0 microversion: 2.1 time: 0.166424 Jul 31 14:26:18.606196 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 246/499] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:26:18 2022] DELETE /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 14:26:18.615705 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5981507b-d8da-43dd-af41-d6d3fb8bc850 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:18.616668 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-5981507b-d8da-43dd-af41-d6d3fb8bc850 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:18.625203 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5981507b-d8da-43dd-af41-d6d3fb8bc850 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:18.625656 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5981507b-d8da-43dd-af41-d6d3fb8bc850 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:18.626322 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-45f3c0bf-51c3-4fba-b1c3-49a8701981a9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:18.626505 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5981507b-d8da-43dd-af41-d6d3fb8bc850 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:18.627117 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5981507b-d8da-43dd-af41-d6d3fb8bc850 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:18.627462 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-45f3c0bf-51c3-4fba-b1c3-49a8701981a9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:18.634762 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-45f3c0bf-51c3-4fba-b1c3-49a8701981a9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:18.635551 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-45f3c0bf-51c3-4fba-b1c3-49a8701981a9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:18.636469 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-45f3c0bf-51c3-4fba-b1c3-49a8701981a9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:18.637017 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-45f3c0bf-51c3-4fba-b1c3-49a8701981a9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:18.828623 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-45f3c0bf-51c3-4fba-b1c3-49a8701981a9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:18.834406 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-5981507b-d8da-43dd-af41-d6d3fb8bc850 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:18.840982 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-45f3c0bf-51c3-4fba-b1c3-49a8701981a9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:18.842517 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-45f3c0bf-51c3-4fba-b1c3-49a8701981a9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:18.843731 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-45f3c0bf-51c3-4fba-b1c3-49a8701981a9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1809 microversion: 2.20 time: 0.225901 Jul 31 14:26:18.855451 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 247/500] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:26:18 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:26:18.855631 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-5981507b-d8da-43dd-af41-d6d3fb8bc850 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 200 len: 1682 microversion: 2.1 time: 0.233157 Jul 31 14:26:18.855631 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 254/501] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:18 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 1682 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:19.584917 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-517455d6-cb35-45e7-85bb-05ccdb2a893d req-b2446e3c-2f9c-4e2a-bfd3-94822e4836b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0810b36-49ee-482b-9e65-f587148b2a81", "name": "network-vif-plugged", "status": "completed", "tag": "24bdbc3b-fa2f-407d-8ddb-f37abeee2dba"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:26:19.602048 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-517455d6-cb35-45e7-85bb-05ccdb2a893d req-b2446e3c-2f9c-4e2a-bfd3-94822e4836b8 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:19.602493 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-517455d6-cb35-45e7-85bb-05ccdb2a893d req-b2446e3c-2f9c-4e2a-bfd3-94822e4836b8 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:19.616366 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-517455d6-cb35-45e7-85bb-05ccdb2a893d req-b2446e3c-2f9c-4e2a-bfd3-94822e4836b8 service nova] Creating event network-vif-plugged:24bdbc3b-fa2f-407d-8ddb-f37abeee2dba for instance d0810b36-49ee-482b-9e65-f587148b2a81 on hv-cinder-84984 Jul 31 14:26:19.639348 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-517455d6-cb35-45e7-85bb-05ccdb2a893d req-b2446e3c-2f9c-4e2a-bfd3-94822e4836b8 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056646 Jul 31 14:26:19.642651 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 248/502] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:26:19.870518 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-035a8bde-ad57-439f-b8bc-6aafe5dc1132 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:19.871333 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-035a8bde-ad57-439f-b8bc-6aafe5dc1132 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:19.875224 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-9e745d80-f950-425a-96c8-c54873f21860 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:19.876120 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-9e745d80-f950-425a-96c8-c54873f21860 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:19.888451 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-035a8bde-ad57-439f-b8bc-6aafe5dc1132 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:19.889118 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-035a8bde-ad57-439f-b8bc-6aafe5dc1132 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:19.891035 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-035a8bde-ad57-439f-b8bc-6aafe5dc1132 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:19.891035 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-035a8bde-ad57-439f-b8bc-6aafe5dc1132 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:19.891379 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9e745d80-f950-425a-96c8-c54873f21860 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:19.891788 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9e745d80-f950-425a-96c8-c54873f21860 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:19.896299 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9e745d80-f950-425a-96c8-c54873f21860 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:19.896763 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9e745d80-f950-425a-96c8-c54873f21860 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:20.150671 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-9e745d80-f950-425a-96c8-c54873f21860 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:20.162590 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-9e745d80-f950-425a-96c8-c54873f21860 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 200 len: 1682 microversion: 2.1 time: 0.294029 Jul 31 14:26:20.164101 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 249/503] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:19 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 1682 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:20.178240 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-035a8bde-ad57-439f-b8bc-6aafe5dc1132 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:20.187469 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-035a8bde-ad57-439f-b8bc-6aafe5dc1132 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:20.189009 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-035a8bde-ad57-439f-b8bc-6aafe5dc1132 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:20.190208 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-035a8bde-ad57-439f-b8bc-6aafe5dc1132 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1809 microversion: 2.20 time: 0.325797 Jul 31 14:26:20.193330 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 255/504] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:26:19 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1809 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:26:21.185714 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-2b84b866-6e17-4e0c-a985-96f10b78cf13 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:21.186315 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-2b84b866-6e17-4e0c-a985-96f10b78cf13 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:21.193505 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2b84b866-6e17-4e0c-a985-96f10b78cf13 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:21.194293 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2b84b866-6e17-4e0c-a985-96f10b78cf13 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:21.195317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2b84b866-6e17-4e0c-a985-96f10b78cf13 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:21.196011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2b84b866-6e17-4e0c-a985-96f10b78cf13 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:21.216628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-16ccccdc-680a-4974-a4c6-aec7857c8b27 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:21.218632 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-16ccccdc-680a-4974-a4c6-aec7857c8b27 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:21.228121 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-16ccccdc-680a-4974-a4c6-aec7857c8b27 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:21.231800 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-16ccccdc-680a-4974-a4c6-aec7857c8b27 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:21.232801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-16ccccdc-680a-4974-a4c6-aec7857c8b27 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:21.233479 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-16ccccdc-680a-4974-a4c6-aec7857c8b27 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:21.433202 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-16ccccdc-680a-4974-a4c6-aec7857c8b27 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:21.445002 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-16ccccdc-680a-4974-a4c6-aec7857c8b27 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:21.449383 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-16ccccdc-680a-4974-a4c6-aec7857c8b27 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:21.451163 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-16ccccdc-680a-4974-a4c6-aec7857c8b27 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1809 microversion: 2.20 time: 0.239093 Jul 31 14:26:21.460890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 256/505] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:26:21 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1809 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:26:21.601589 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-2b84b866-6e17-4e0c-a985-96f10b78cf13 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:21.619597 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-2b84b866-6e17-4e0c-a985-96f10b78cf13 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 200 len: 1682 microversion: 2.1 time: 0.437572 Jul 31 14:26:21.628871 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 250/506] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:21 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 1682 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:22.196323 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-f4a190bd-3f19-45ea-8b4d-2a3cb91616e9 req-de8aa4f6-a5dd-4778-87c5-df6119d46539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5b3d28-2f47-4309-a909-0210c782aad3", "name": "network-vif-deleted", "tag": "78bad9ba-f468-4e03-9786-7c27cd0658de"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:26:22.217633 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-f4a190bd-3f19-45ea-8b4d-2a3cb91616e9 req-de8aa4f6-a5dd-4778-87c5-df6119d46539 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:22.218452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-f4a190bd-3f19-45ea-8b4d-2a3cb91616e9 req-de8aa4f6-a5dd-4778-87c5-df6119d46539 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:22.266533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-f4a190bd-3f19-45ea-8b4d-2a3cb91616e9 req-de8aa4f6-a5dd-4778-87c5-df6119d46539 service nova] Creating event network-vif-deleted:78bad9ba-f468-4e03-9786-7c27cd0658de for instance ed5b3d28-2f47-4309-a909-0210c782aad3 on hv-cinder-84984 Jul 31 14:26:22.277255 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-f4a190bd-3f19-45ea-8b4d-2a3cb91616e9 req-de8aa4f6-a5dd-4778-87c5-df6119d46539 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083872 Jul 31 14:26:22.286092 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 257/507] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:26:22.475770 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-2fc4f0cb-e3ea-4df5-822b-1869cf7fe363 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:22.476397 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-2fc4f0cb-e3ea-4df5-822b-1869cf7fe363 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:22.487909 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2fc4f0cb-e3ea-4df5-822b-1869cf7fe363 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:22.489469 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2fc4f0cb-e3ea-4df5-822b-1869cf7fe363 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:22.491853 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2fc4f0cb-e3ea-4df5-822b-1869cf7fe363 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:22.493540 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2fc4f0cb-e3ea-4df5-822b-1869cf7fe363 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:22.643386 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e2593988-769c-4424-bf3e-c8858a6734f1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:22.644099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e2593988-769c-4424-bf3e-c8858a6734f1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:22.656653 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e2593988-769c-4424-bf3e-c8858a6734f1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:22.657104 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e2593988-769c-4424-bf3e-c8858a6734f1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:22.657885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e2593988-769c-4424-bf3e-c8858a6734f1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:22.658321 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e2593988-769c-4424-bf3e-c8858a6734f1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:22.808554 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e2593988-769c-4424-bf3e-c8858a6734f1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:22.816277 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e2593988-769c-4424-bf3e-c8858a6734f1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 200 len: 1326 microversion: 2.1 time: 0.178042 Jul 31 14:26:22.822159 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 258/508] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:22 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 1326 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:26:22.840178 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-2fc4f0cb-e3ea-4df5-822b-1869cf7fe363 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:22.849843 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-2fc4f0cb-e3ea-4df5-822b-1869cf7fe363 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:22.851630 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-2fc4f0cb-e3ea-4df5-822b-1869cf7fe363 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:22.852967 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-2fc4f0cb-e3ea-4df5-822b-1869cf7fe363 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1809 microversion: 2.20 time: 0.381568 Jul 31 14:26:22.854123 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 251/509] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:26:22 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1809 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:26:23.839886 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8456398d-b114-4340-93a4-37612b79027e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:23.853769 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8456398d-b114-4340-93a4-37612b79027e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:23.876923 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-c906d5d4-9da1-42c7-90f2-871749ad3ebd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:23.878665 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-c906d5d4-9da1-42c7-90f2-871749ad3ebd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:23.895948 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8456398d-b114-4340-93a4-37612b79027e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:23.896931 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c906d5d4-9da1-42c7-90f2-871749ad3ebd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:23.897389 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c906d5d4-9da1-42c7-90f2-871749ad3ebd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:23.897823 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8456398d-b114-4340-93a4-37612b79027e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:23.898635 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8456398d-b114-4340-93a4-37612b79027e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:23.899076 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8456398d-b114-4340-93a4-37612b79027e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:23.900803 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c906d5d4-9da1-42c7-90f2-871749ad3ebd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:23.901254 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c906d5d4-9da1-42c7-90f2-871749ad3ebd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:23.938950 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-8456398d-b114-4340-93a4-37612b79027e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] HTTP exception thrown: Instance ed5b3d28-2f47-4309-a909-0210c782aad3 could not be found. Jul 31 14:26:23.944759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8456398d-b114-4340-93a4-37612b79027e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Request method failure captured: Jul 31 14:26:23.944759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 HTTP/1.1 Jul 31 14:26:23.944759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:26:23.944759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:26:23.944759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:26:23.944759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:26:23.944759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:26:23.944759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:26:23.944759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:26:23.944759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:26:23.944759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pA3RnV2a-dDWWL-_ZfxXcr4UktgQI-9SWPGN4xUIh3gpaTPpUlCMNWU1g96nJfR_a1KYUrPG43SkpeWWkH3LXQwcjtBN7d_0kQ02fiRqueKY6XZVQNh8gR0_ddCj_gKuHBtsN430P5RXgDqCVuPQ_rcT-N1y6dWBKzFpQGKjlxkqC0 Jul 31 14:26:23.944759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:26:23.944759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:26:23.944759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:26:23.944759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:26:23.944759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:26:23.944759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:26:23.944759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:26:23.944759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:26:23.944759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:26:23.944759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:26:23.946807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9097fd66951e457ba46812ff17db7501", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9097fd66951e457ba46812ff17db7501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:26:23.946807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:26:23.946807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:26:23.946807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:26:23.946807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:26:23.946807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:26:23.946807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:26:23.946807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: d6e8399080a942f1b689fc8c6b42c717 Jul 31 14:26:23.946807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:26:23.946807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:26:23.946807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance ed5b3d28-2f47-4309-a909-0210c782aad3 could not be found. Jul 31 14:26:23.946807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': 'ed5b3d28-2f47-4309-a909-0210c782aad3'} Jul 31 14:26:23.947801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:26:23.947801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:26:23.947801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:26:23.947801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:26:23.947801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:26:23.947801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:26:23.947801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:26:23.947801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:26:23.947801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:26:23.947801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:26:23.947801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed5b3d28-2f47-4309-a909-0210c782aad3 could not be found. Jul 31 14:26:23.947801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:26:23.947801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:26:23.947801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:26:23.947801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:26:23.947801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:26:23.947801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:26:23.947801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:26:23.947801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:26:23.947801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:26:23.949582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:26:23.949582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:26:23.949582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:26:23.949582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:26:23.949582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:26:23.949582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:26:23.949582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:26:23.949582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed5b3d28-2f47-4309-a909-0210c782aad3 could not be found. Jul 31 14:26:23.949582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:26:23.949582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:26:23.949582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:26:23.949582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:26:23.949582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:26:23.949582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:26:23.949582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:26:23.949582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:26:23.949582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed5b3d28-2f47-4309-a909-0210c782aad3 could not be found. Jul 31 14:26:23.949582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:26:23.953219 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8456398d-b114-4340-93a4-37612b79027e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Returning 404 to user: Instance ed5b3d28-2f47-4309-a909-0210c782aad3 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:26:23.956945 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8456398d-b114-4340-93a4-37612b79027e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 404 len: 111 microversion: 2.1 time: 0.121835 Jul 31 14:26:23.962091 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 259/510] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:23 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:26:23.973198 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0413f84c-c6f3-4ec0-9229-52959a0a50a7 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '.version_select at 0x7f87e9b12ca0>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:24.021971 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0413f84c-c6f3-4ec0-9229-52959a0a50a7 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1022708853" status: 202 len: 0 microversion: 2.1 time: 0.056026 Jul 31 14:26:24.023488 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 260/511] 10.222.0.40 () {58 vars in 1221 bytes} [Sun Jul 31 14:26:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1022708853 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:26:24.230749 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c906d5d4-9da1-42c7-90f2-871749ad3ebd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:24.240400 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c906d5d4-9da1-42c7-90f2-871749ad3ebd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:24.243884 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c906d5d4-9da1-42c7-90f2-871749ad3ebd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:24.245343 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-c906d5d4-9da1-42c7-90f2-871749ad3ebd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1796 microversion: 2.20 time: 0.372295 Jul 31 14:26:24.268472 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 252/512] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:26:23 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1796 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:26:25.089629 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-aa110431-d32c-4da2-8078-74c9f2b40b5f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:25.090255 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-aa110431-d32c-4da2-8078-74c9f2b40b5f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:25.098592 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aa110431-d32c-4da2-8078-74c9f2b40b5f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:25.109424 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aa110431-d32c-4da2-8078-74c9f2b40b5f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:25.110372 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aa110431-d32c-4da2-8078-74c9f2b40b5f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:25.110815 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aa110431-d32c-4da2-8078-74c9f2b40b5f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:25.258168 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-aa110431-d32c-4da2-8078-74c9f2b40b5f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lazy-loading 'services' on Instance uuid e4f24854-1bcd-405b-9af8-fd3f3967d16b {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:26:25.414309 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-aa110431-d32c-4da2-8078-74c9f2b40b5f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b/os-volume_attachments/b54d681e-8d1b-4645-827c-e1e2122ae289" status: 202 len: 0 microversion: 2.1 time: 0.329227 Jul 31 14:26:25.418906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 261/513] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Jul 31 14:26:25 2022] DELETE /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b/os-volume_attachments/b54d681e-8d1b-4645-827c-e1e2122ae289 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:26:25.424712 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-1cab4b6e-163c-439f-bebc-da2826052e4b tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:25.431726 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-1cab4b6e-163c-439f-bebc-da2826052e4b tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:25.439072 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1cab4b6e-163c-439f-bebc-da2826052e4b tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:25.439806 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1cab4b6e-163c-439f-bebc-da2826052e4b tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:25.444542 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1cab4b6e-163c-439f-bebc-da2826052e4b tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:25.445243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1cab4b6e-163c-439f-bebc-da2826052e4b tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:25.497874 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-1cab4b6e-163c-439f-bebc-da2826052e4b tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077853 Jul 31 14:26:25.498769 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 253/514] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Jul 31 14:26:25 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:26:26.512003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-94d78983-5280-498e-bc0c-6ab01fe363bc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:26.514186 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-94d78983-5280-498e-bc0c-6ab01fe363bc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:26.520830 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-94d78983-5280-498e-bc0c-6ab01fe363bc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:26.521274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-94d78983-5280-498e-bc0c-6ab01fe363bc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:26.522043 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-94d78983-5280-498e-bc0c-6ab01fe363bc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:26.522469 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-94d78983-5280-498e-bc0c-6ab01fe363bc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:26.555311 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-94d78983-5280-498e-bc0c-6ab01fe363bc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047942 Jul 31 14:26:26.555837 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 262/515] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Jul 31 14:26:26 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 14:26:26.623284 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-8f499c4b-d9e4-4820-b70b-02f6321e37a7 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:26.623977 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-8f499c4b-d9e4-4820-b70b-02f6321e37a7 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:26.631673 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8f499c4b-d9e4-4820-b70b-02f6321e37a7 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:26.632129 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8f499c4b-d9e4-4820-b70b-02f6321e37a7 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:26.632916 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8f499c4b-d9e4-4820-b70b-02f6321e37a7 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:26.633354 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8f499c4b-d9e4-4820-b70b-02f6321e37a7 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:26.662817 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-8f499c4b-d9e4-4820-b70b-02f6321e37a7 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Going to try to terminate instance {{(pid=117781) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 14:26:26.791368 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-8f499c4b-d9e4-4820-b70b-02f6321e37a7 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 204 len: 0 microversion: 2.1 time: 0.171673 Jul 31 14:26:26.791925 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 254/516] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:26:26 2022] DELETE /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 14:26:26.801431 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2e174661-aaa6-4643-b4d9-362dc779eaa9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:26.802124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2e174661-aaa6-4643-b4d9-362dc779eaa9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:26.808173 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2e174661-aaa6-4643-b4d9-362dc779eaa9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:26.808682 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2e174661-aaa6-4643-b4d9-362dc779eaa9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:26.809503 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2e174661-aaa6-4643-b4d9-362dc779eaa9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:26.810129 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2e174661-aaa6-4643-b4d9-362dc779eaa9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:26.951654 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2e174661-aaa6-4643-b4d9-362dc779eaa9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:26.960661 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2e174661-aaa6-4643-b4d9-362dc779eaa9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1680 microversion: 2.1 time: 0.164299 Jul 31 14:26:26.961386 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 263/517] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:26 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:27.338936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-60ee7058-e5b4-4bd0-a78d-e0a021f7c242 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Action: 'create', calling method: .version_select at 0x7f87e9a9d280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-738499298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjJqQ4wGMpaA5+UsGZJ0OWSIdi0ni9UlT91NaIYED4JLECSs85vmXdc4ccQxmrXWIIyDARfE9B9Y8YwVPPA/aYMovXeOp9sjehMLGmeljMvqiLeug+s6WFQ0nuFSsHjeQ=="}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:26:27.354498 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-60ee7058-e5b4-4bd0-a78d-e0a021f7c242 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Getting quotas for project ea0d7081bf384d098fad20ef507f4dfd. Resources: {'key_pairs'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:26:27.358286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-60ee7058-e5b4-4bd0-a78d-e0a021f7c242 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Getting quotas for user 3b003c297b914cb08f737b1f4d40b16d and project ea0d7081bf384d098fad20ef507f4dfd. Resources: {'key_pairs'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:26:27.379866 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-60ee7058-e5b4-4bd0-a78d-e0a021f7c242 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.045039 Jul 31 14:26:27.380474 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 255/518] 10.222.0.40 () {60 vars in 1159 bytes} [Sun Jul 31 14:26:27 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:26:27.431689 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0e4ae419-52db-45d8-921d-6a1cae00ab50 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-458011107", "imageRef": "acbc06e0-3e7e-4bab-937f-47ef240387aa", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-738499298", "networks": [{"uuid": "e58b26df-798a-497d-9c1b-d5d30155e23a"}]}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:26:27.483167 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.network.neutron [None req-0e4ae419-52db-45d8-921d-6a1cae00ab50 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] validate_networks() for [('e58b26df-798a-497d-9c1b-d5d30155e23a', None, None, None, None, None)] {{(pid=117780) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 14:26:27.845061 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-0e4ae419-52db-45d8-921d-6a1cae00ab50 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Flavor limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 14:26:27.845061 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-0e4ae419-52db-45d8-921d-6a1cae00ab50 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Image limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 14:26:27.845662 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-0e4ae419-52db-45d8-921d-6a1cae00ab50 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Flavor pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 14:26:27.845874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-0e4ae419-52db-45d8-921d-6a1cae00ab50 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Image pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 14:26:27.846283 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-0e4ae419-52db-45d8-921d-6a1cae00ab50 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 14:26:27.855610 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0e4ae419-52db-45d8-921d-6a1cae00ab50 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:27.856077 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0e4ae419-52db-45d8-921d-6a1cae00ab50 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:27.856861 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0e4ae419-52db-45d8-921d-6a1cae00ab50 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:27.857293 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0e4ae419-52db-45d8-921d-6a1cae00ab50 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:27.873799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-0e4ae419-52db-45d8-921d-6a1cae00ab50 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Getting quotas for project ea0d7081bf384d098fad20ef507f4dfd. Resources: {'cores', 'ram', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:26:27.877594 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-0e4ae419-52db-45d8-921d-6a1cae00ab50 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Getting quotas for user 3b003c297b914cb08f737b1f4d40b16d and project ea0d7081bf384d098fad20ef507f4dfd. Resources: {'cores', 'ram', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:26:27.888564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0e4ae419-52db-45d8-921d-6a1cae00ab50 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Going to run 1 instances... {{(pid=117780) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 14:26:27.890959 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0e4ae419-52db-45d8-921d-6a1cae00ab50 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='acbc06e0-3e7e-4bab-937f-47ef240387aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 14:26:27.933231 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0e4ae419-52db-45d8-921d-6a1cae00ab50 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505383 Jul 31 14:26:27.933867 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 264/519] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Jul 31 14:26:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 14:26:27.944878 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-e650f39b-e5c6-4d02-a739-59b9aa8402d1 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:27.945607 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-e650f39b-e5c6-4d02-a739-59b9aa8402d1 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:27.982510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4f58e0b6-c1da-40c8-9122-3493b483f061 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:27.983120 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4f58e0b6-c1da-40c8-9122-3493b483f061 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:27.993373 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4f58e0b6-c1da-40c8-9122-3493b483f061 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:27.993756 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4f58e0b6-c1da-40c8-9122-3493b483f061 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:27.994534 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4f58e0b6-c1da-40c8-9122-3493b483f061 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:27.994968 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4f58e0b6-c1da-40c8-9122-3493b483f061 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:28.000335 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e650f39b-e5c6-4d02-a739-59b9aa8402d1 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:28.007052 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-e650f39b-e5c6-4d02-a739-59b9aa8402d1 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1257 microversion: 2.1 time: 0.066476 Jul 31 14:26:28.021294 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 256/520] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:27 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:28.126621 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4f58e0b6-c1da-40c8-9122-3493b483f061 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:28.134157 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4f58e0b6-c1da-40c8-9122-3493b483f061 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1680 microversion: 2.1 time: 0.155849 Jul 31 14:26:28.135078 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 265/521] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:27 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:26:29.028913 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-2936ff08-22df-48c1-b2d7-795f87d8192d tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:29.029674 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-2936ff08-22df-48c1-b2d7-795f87d8192d tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:29.036728 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2936ff08-22df-48c1-b2d7-795f87d8192d tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:29.037181 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2936ff08-22df-48c1-b2d7-795f87d8192d tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:29.037961 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2936ff08-22df-48c1-b2d7-795f87d8192d tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:29.038405 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2936ff08-22df-48c1-b2d7-795f87d8192d tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:29.147660 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-2936ff08-22df-48c1-b2d7-795f87d8192d tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:29.158544 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f52cefe8-3cb5-4c3c-bf31-91091deb6b4f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:29.159104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-2936ff08-22df-48c1-b2d7-795f87d8192d tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1317 microversion: 2.1 time: 0.133593 Jul 31 14:26:29.171456 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 257/522] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:29 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1317 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:29.172369 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f52cefe8-3cb5-4c3c-bf31-91091deb6b4f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:29.182673 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f52cefe8-3cb5-4c3c-bf31-91091deb6b4f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:29.183503 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f52cefe8-3cb5-4c3c-bf31-91091deb6b4f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:29.183856 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f52cefe8-3cb5-4c3c-bf31-91091deb6b4f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:29.184290 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f52cefe8-3cb5-4c3c-bf31-91091deb6b4f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:29.254824 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f52cefe8-3cb5-4c3c-bf31-91091deb6b4f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:29.262643 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f52cefe8-3cb5-4c3c-bf31-91091deb6b4f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1613 microversion: 2.1 time: 0.108837 Jul 31 14:26:29.263208 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 266/523] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:29 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1613 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:26:30.106180 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-e384b565-8db1-4ed7-b27b-5051c1a32a23 req-1bb718a7-7bfc-4877-8882-ff4dadc3863c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4f24854-1bcd-405b-9af8-fd3f3967d16b", "name": "network-vif-deleted", "tag": "21edb8cd-f77a-499c-afac-f0de24050b9d"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:26:30.122053 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-e384b565-8db1-4ed7-b27b-5051c1a32a23 req-1bb718a7-7bfc-4877-8882-ff4dadc3863c service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:30.126128 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-e384b565-8db1-4ed7-b27b-5051c1a32a23 req-1bb718a7-7bfc-4877-8882-ff4dadc3863c service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:30.146070 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-e384b565-8db1-4ed7-b27b-5051c1a32a23 req-1bb718a7-7bfc-4877-8882-ff4dadc3863c service nova] Creating event network-vif-deleted:21edb8cd-f77a-499c-afac-f0de24050b9d for instance e4f24854-1bcd-405b-9af8-fd3f3967d16b on hv-cinder-84984 Jul 31 14:26:30.152680 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-e384b565-8db1-4ed7-b27b-5051c1a32a23 req-1bb718a7-7bfc-4877-8882-ff4dadc3863c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050110 Jul 31 14:26:30.154154 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 258/524] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:26:30.185290 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d42c7fc0-66ea-485c-9f88-2f4b87575c73 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:30.186612 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d42c7fc0-66ea-485c-9f88-2f4b87575c73 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:30.201929 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d42c7fc0-66ea-485c-9f88-2f4b87575c73 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:30.202393 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d42c7fc0-66ea-485c-9f88-2f4b87575c73 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:30.203204 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d42c7fc0-66ea-485c-9f88-2f4b87575c73 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:30.203698 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d42c7fc0-66ea-485c-9f88-2f4b87575c73 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:30.284984 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-dfe82ed2-3b73-4849-81f7-f3d9b3afbac8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:30.286158 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-dfe82ed2-3b73-4849-81f7-f3d9b3afbac8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:30.297613 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dfe82ed2-3b73-4849-81f7-f3d9b3afbac8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:30.298176 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dfe82ed2-3b73-4849-81f7-f3d9b3afbac8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:30.298992 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dfe82ed2-3b73-4849-81f7-f3d9b3afbac8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:30.308989 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dfe82ed2-3b73-4849-81f7-f3d9b3afbac8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:30.352403 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:26:30.480272 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-dfe82ed2-3b73-4849-81f7-f3d9b3afbac8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:30.488390 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-dfe82ed2-3b73-4849-81f7-f3d9b3afbac8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1613 microversion: 2.1 time: 0.207741 Jul 31 14:26:30.495909 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 259/525] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:30 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1613 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:30.643533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d42c7fc0-66ea-485c-9f88-2f4b87575c73 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:30.653216 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d42c7fc0-66ea-485c-9f88-2f4b87575c73 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1315 microversion: 2.1 time: 0.472095 Jul 31 14:26:30.668829 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 267/526] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:30 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:31.521161 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-285b31cd-5f25-438d-9264-4d9a31dcd466 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:31.523131 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-285b31cd-5f25-438d-9264-4d9a31dcd466 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:31.530649 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-285b31cd-5f25-438d-9264-4d9a31dcd466 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:31.531337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-285b31cd-5f25-438d-9264-4d9a31dcd466 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:31.532365 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-285b31cd-5f25-438d-9264-4d9a31dcd466 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:31.533388 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-285b31cd-5f25-438d-9264-4d9a31dcd466 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:31.614276 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-285b31cd-5f25-438d-9264-4d9a31dcd466 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:31.622606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-285b31cd-5f25-438d-9264-4d9a31dcd466 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1613 microversion: 2.1 time: 0.105662 Jul 31 14:26:31.623186 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 260/527] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:31 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1613 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:31.674547 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d3d5b509-638b-4d9a-aadb-769ad19da549 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:31.675309 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d3d5b509-638b-4d9a-aadb-769ad19da549 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:31.682608 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d3d5b509-638b-4d9a-aadb-769ad19da549 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:31.683136 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d3d5b509-638b-4d9a-aadb-769ad19da549 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:31.684155 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d3d5b509-638b-4d9a-aadb-769ad19da549 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:31.684777 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d3d5b509-638b-4d9a-aadb-769ad19da549 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:31.837512 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d3d5b509-638b-4d9a-aadb-769ad19da549 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:31.845217 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d3d5b509-638b-4d9a-aadb-769ad19da549 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1357 microversion: 2.1 time: 0.174379 Jul 31 14:26:31.845790 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 268/528] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:31 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:32.644237 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7e09e62e-5df7-4d9a-a77e-ffb4e622d3de tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:32.645296 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7e09e62e-5df7-4d9a-a77e-ffb4e622d3de tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:32.652483 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7e09e62e-5df7-4d9a-a77e-ffb4e622d3de tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:32.653148 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7e09e62e-5df7-4d9a-a77e-ffb4e622d3de tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:32.654011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7e09e62e-5df7-4d9a-a77e-ffb4e622d3de tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:32.654538 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7e09e62e-5df7-4d9a-a77e-ffb4e622d3de tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:32.722190 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7e09e62e-5df7-4d9a-a77e-ffb4e622d3de tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:32.729868 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7e09e62e-5df7-4d9a-a77e-ffb4e622d3de tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1613 microversion: 2.1 time: 0.089458 Jul 31 14:26:32.730444 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 261/529] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:32 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:32.866137 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fcc53131-aa5c-4877-8c92-b21dc84ccc0b tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:32.866971 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fcc53131-aa5c-4877-8c92-b21dc84ccc0b tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:32.869442 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:26:32.875796 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fcc53131-aa5c-4877-8c92-b21dc84ccc0b tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:32.879130 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fcc53131-aa5c-4877-8c92-b21dc84ccc0b tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:32.880060 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fcc53131-aa5c-4877-8c92-b21dc84ccc0b tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:32.880508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fcc53131-aa5c-4877-8c92-b21dc84ccc0b tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:33.028761 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fcc53131-aa5c-4877-8c92-b21dc84ccc0b tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:33.036546 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fcc53131-aa5c-4877-8c92-b21dc84ccc0b tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1357 microversion: 2.1 time: 0.174254 Jul 31 14:26:33.037479 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 269/530] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:32 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:33.752368 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-579b5905-6fac-46e9-ac60-83775fba3fdc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:33.753090 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-579b5905-6fac-46e9-ac60-83775fba3fdc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:33.760021 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-579b5905-6fac-46e9-ac60-83775fba3fdc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:33.760558 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-579b5905-6fac-46e9-ac60-83775fba3fdc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:33.761338 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-579b5905-6fac-46e9-ac60-83775fba3fdc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:33.761770 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-579b5905-6fac-46e9-ac60-83775fba3fdc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:33.828692 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-579b5905-6fac-46e9-ac60-83775fba3fdc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:33.837260 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-579b5905-6fac-46e9-ac60-83775fba3fdc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1613 microversion: 2.1 time: 0.088850 Jul 31 14:26:33.838061 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 262/531] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:33 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1613 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:34.059047 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5fe43617-5f02-45f5-83fc-5879266f4ee9 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:34.059709 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-5fe43617-5f02-45f5-83fc-5879266f4ee9 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:34.067196 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5fe43617-5f02-45f5-83fc-5879266f4ee9 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:34.067661 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5fe43617-5f02-45f5-83fc-5879266f4ee9 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:34.068426 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5fe43617-5f02-45f5-83fc-5879266f4ee9 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:34.068851 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5fe43617-5f02-45f5-83fc-5879266f4ee9 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:34.201971 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-5fe43617-5f02-45f5-83fc-5879266f4ee9 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:34.212356 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-5fe43617-5f02-45f5-83fc-5879266f4ee9 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1357 microversion: 2.1 time: 0.157090 Jul 31 14:26:34.223915 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 270/532] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:34 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:34.858189 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-4fefe2a2-cc7a-4ac1-80ca-71c438b184d2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:34.858798 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-4fefe2a2-cc7a-4ac1-80ca-71c438b184d2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:34.865771 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4fefe2a2-cc7a-4ac1-80ca-71c438b184d2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:34.866212 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4fefe2a2-cc7a-4ac1-80ca-71c438b184d2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:34.866965 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4fefe2a2-cc7a-4ac1-80ca-71c438b184d2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:34.867391 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4fefe2a2-cc7a-4ac1-80ca-71c438b184d2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:34.932849 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-4fefe2a2-cc7a-4ac1-80ca-71c438b184d2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:34.941816 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-4fefe2a2-cc7a-4ac1-80ca-71c438b184d2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1613 microversion: 2.1 time: 0.086807 Jul 31 14:26:34.942385 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 263/533] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:34 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1613 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:35.234295 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-cb4f095c-3aae-4763-a53b-56130f738017 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:35.234907 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-cb4f095c-3aae-4763-a53b-56130f738017 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:35.242322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cb4f095c-3aae-4763-a53b-56130f738017 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:35.242767 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cb4f095c-3aae-4763-a53b-56130f738017 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:35.243584 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cb4f095c-3aae-4763-a53b-56130f738017 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:35.244017 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cb4f095c-3aae-4763-a53b-56130f738017 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:35.389075 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-cb4f095c-3aae-4763-a53b-56130f738017 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:35.397330 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-cb4f095c-3aae-4763-a53b-56130f738017 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1357 microversion: 2.1 time: 0.166896 Jul 31 14:26:35.405176 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 271/534] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:35 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:35.964503 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-747de7e7-298d-4a69-a710-73b70f96327c tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:35.965115 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-747de7e7-298d-4a69-a710-73b70f96327c tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:35.971129 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-747de7e7-298d-4a69-a710-73b70f96327c tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:35.971611 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-747de7e7-298d-4a69-a710-73b70f96327c tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:35.972452 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-747de7e7-298d-4a69-a710-73b70f96327c tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:35.972885 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-747de7e7-298d-4a69-a710-73b70f96327c tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:36.042413 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-747de7e7-298d-4a69-a710-73b70f96327c tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:36.050148 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-747de7e7-298d-4a69-a710-73b70f96327c tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1613 microversion: 2.1 time: 0.089947 Jul 31 14:26:36.050809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 264/535] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:35 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:36.418076 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6600c38c-e020-40e6-a4c5-fc6ef888ebbf tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:36.418608 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6600c38c-e020-40e6-a4c5-fc6ef888ebbf tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:36.425161 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6600c38c-e020-40e6-a4c5-fc6ef888ebbf tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:36.425670 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6600c38c-e020-40e6-a4c5-fc6ef888ebbf tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:36.426441 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6600c38c-e020-40e6-a4c5-fc6ef888ebbf tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:36.426875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6600c38c-e020-40e6-a4c5-fc6ef888ebbf tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:36.561241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6600c38c-e020-40e6-a4c5-fc6ef888ebbf tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:36.564661 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:26:36.570378 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6600c38c-e020-40e6-a4c5-fc6ef888ebbf tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1357 microversion: 2.1 time: 0.156182 Jul 31 14:26:36.571041 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 272/536] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:36 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:36.611692 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-aba65e2d-54f4-445e-8a9f-eac5df483d51 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9674eddb-1c82-4c41-99cf-406a9ae8f33e"}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:26:36.614031 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-aba65e2d-54f4-445e-8a9f-eac5df483d51 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:36.620321 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-aba65e2d-54f4-445e-8a9f-eac5df483d51 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:36.620776 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-aba65e2d-54f4-445e-8a9f-eac5df483d51 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:36.621551 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-aba65e2d-54f4-445e-8a9f-eac5df483d51 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:36.621991 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-aba65e2d-54f4-445e-8a9f-eac5df483d51 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:37.072736 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6c27b05e-ee41-4ebf-915e-971c0415b56c tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:37.073258 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6c27b05e-ee41-4ebf-915e-971c0415b56c tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:37.079880 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6c27b05e-ee41-4ebf-915e-971c0415b56c tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:37.080321 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6c27b05e-ee41-4ebf-915e-971c0415b56c tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:37.081074 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6c27b05e-ee41-4ebf-915e-971c0415b56c tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:37.081532 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6c27b05e-ee41-4ebf-915e-971c0415b56c tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:37.144755 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6c27b05e-ee41-4ebf-915e-971c0415b56c tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:37.152444 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6c27b05e-ee41-4ebf-915e-971c0415b56c tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1613 microversion: 2.1 time: 0.084267 Jul 31 14:26:37.153016 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 273/537] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:37 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1613 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:37.591663 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c80effa5-1c58-419e-ae25-a5dd40f375e4 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:37.592415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c80effa5-1c58-419e-ae25-a5dd40f375e4 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:37.599242 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c80effa5-1c58-419e-ae25-a5dd40f375e4 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:37.599709 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c80effa5-1c58-419e-ae25-a5dd40f375e4 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:37.600463 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c80effa5-1c58-419e-ae25-a5dd40f375e4 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:37.600890 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c80effa5-1c58-419e-ae25-a5dd40f375e4 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:37.733780 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c80effa5-1c58-419e-ae25-a5dd40f375e4 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:37.742183 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c80effa5-1c58-419e-ae25-a5dd40f375e4 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1357 microversion: 2.1 time: 0.154217 Jul 31 14:26:37.742777 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 274/538] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:37 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:26:38.005109 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=6 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:26:38.177317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-71b3deea-ef4f-49be-8e46-daa7e99e05ac tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:38.178015 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-71b3deea-ef4f-49be-8e46-daa7e99e05ac tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:38.180003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:26:38.180651 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=6 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:26:38.186599 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-71b3deea-ef4f-49be-8e46-daa7e99e05ac tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:38.187038 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-71b3deea-ef4f-49be-8e46-daa7e99e05ac tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:38.187816 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-71b3deea-ef4f-49be-8e46-daa7e99e05ac tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:38.188240 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-71b3deea-ef4f-49be-8e46-daa7e99e05ac tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:38.248795 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-71b3deea-ef4f-49be-8e46-daa7e99e05ac tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:38.256582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-71b3deea-ef4f-49be-8e46-daa7e99e05ac tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 200 len: 1613 microversion: 2.1 time: 0.083536 Jul 31 14:26:38.257144 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 275/539] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:38 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 1613 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:26:38.630826 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-aba65e2d-54f4-445e-8a9f-eac5df483d51 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "POST /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.023094 Jul 31 14:26:38.636938 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 265/540] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Jul 31 14:26:36 2022] POST /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e/os-volume_attachments => generated 194 bytes in 2025 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:26:38.767599 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-16bb3cb1-cdc7-4741-8a86-345086ecffcb tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:38.768229 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-16bb3cb1-cdc7-4741-8a86-345086ecffcb tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:38.774644 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-16bb3cb1-cdc7-4741-8a86-345086ecffcb tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:38.775083 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-16bb3cb1-cdc7-4741-8a86-345086ecffcb tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:38.776027 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-16bb3cb1-cdc7-4741-8a86-345086ecffcb tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:38.776513 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-16bb3cb1-cdc7-4741-8a86-345086ecffcb tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:38.910723 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-16bb3cb1-cdc7-4741-8a86-345086ecffcb tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:38.918587 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-16bb3cb1-cdc7-4741-8a86-345086ecffcb tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1357 microversion: 2.1 time: 0.154864 Jul 31 14:26:38.919234 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 276/541] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:38 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:38.956872 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-9cb6eca9-7499-486d-ba17-48fb633e6942 req-3593bd95-18b2-415a-a970-525d814bd7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb0fe7f8-51ab-4016-9142-4a9d2fda34a7", "tag": "2da882f0-72a7-499f-8313-43b198253581"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:26:38.977742 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-9cb6eca9-7499-486d-ba17-48fb633e6942 req-3593bd95-18b2-415a-a970-525d814bd7d6 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:38.978184 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-9cb6eca9-7499-486d-ba17-48fb633e6942 req-3593bd95-18b2-415a-a970-525d814bd7d6 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:38.991196 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-9cb6eca9-7499-486d-ba17-48fb633e6942 req-3593bd95-18b2-415a-a970-525d814bd7d6 service nova] Creating event network-changed:2da882f0-72a7-499f-8313-43b198253581 for instance fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 on hv-cinder-84984 Jul 31 14:26:38.997531 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-9cb6eca9-7499-486d-ba17-48fb633e6942 req-3593bd95-18b2-415a-a970-525d814bd7d6 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045485 Jul 31 14:26:38.998552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 266/542] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:26:39.278210 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9af9bfe3-5794-4ea8-98d3-cdee0d078703 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:39.278908 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9af9bfe3-5794-4ea8-98d3-cdee0d078703 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:39.285507 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9af9bfe3-5794-4ea8-98d3-cdee0d078703 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:39.286021 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9af9bfe3-5794-4ea8-98d3-cdee0d078703 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:39.286850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9af9bfe3-5794-4ea8-98d3-cdee0d078703 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:39.287379 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9af9bfe3-5794-4ea8-98d3-cdee0d078703 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:39.301345 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-9af9bfe3-5794-4ea8-98d3-cdee0d078703 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] HTTP exception thrown: Instance e4f24854-1bcd-405b-9af8-fd3f3967d16b could not be found. Jul 31 14:26:39.303037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9af9bfe3-5794-4ea8-98d3-cdee0d078703 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Request method failure captured: Jul 31 14:26:39.303037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b HTTP/1.1 Jul 31 14:26:39.303037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:26:39.303037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:26:39.303037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:26:39.303037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:26:39.303037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:26:39.303037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:26:39.303037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:26:39.303037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:26:39.303037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pA3RnV2a-dDWWL-_ZfxXcr4UktgQI-9SWPGN4xUIh3gpaTPpUlCMNWU1g96nJfR_a1KYUrPG43SkpeWWkH3LXQwcjtBN7d_0kQ02fiRqueKY6XZVQNh8gR0_ddCj_gKuHBtsN430P5RXgDqCVuPQ_rcT-N1y6dWBKzFpQGKjlxkqC0 Jul 31 14:26:39.303037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:26:39.303037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:26:39.303037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:26:39.303037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:26:39.303037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:26:39.303037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:26:39.303037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:26:39.303037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:26:39.303037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:26:39.303037 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:26:39.304533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9097fd66951e457ba46812ff17db7501", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9097fd66951e457ba46812ff17db7501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:26:39.304533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:26:39.304533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:26:39.304533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:26:39.304533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:26:39.304533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:26:39.304533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:26:39.304533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: d6e8399080a942f1b689fc8c6b42c717 Jul 31 14:26:39.304533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:26:39.304533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:26:39.304533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance e4f24854-1bcd-405b-9af8-fd3f3967d16b could not be found. Jul 31 14:26:39.304533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': 'e4f24854-1bcd-405b-9af8-fd3f3967d16b'} Jul 31 14:26:39.305274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:26:39.305274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:26:39.305274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:26:39.305274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:26:39.305274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:26:39.305274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:26:39.305274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:26:39.305274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:26:39.305274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:26:39.305274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:26:39.305274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4f24854-1bcd-405b-9af8-fd3f3967d16b could not be found. Jul 31 14:26:39.305274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:26:39.305274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:26:39.305274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:26:39.305274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:26:39.305274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:26:39.305274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:26:39.305274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:26:39.305274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:26:39.305274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:26:39.306508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:26:39.306508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:26:39.306508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:26:39.306508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:26:39.306508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:26:39.306508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:26:39.306508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:26:39.306508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4f24854-1bcd-405b-9af8-fd3f3967d16b could not be found. Jul 31 14:26:39.306508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:26:39.306508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:26:39.306508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:26:39.306508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:26:39.306508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:26:39.306508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:26:39.306508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:26:39.306508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:26:39.306508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4f24854-1bcd-405b-9af8-fd3f3967d16b could not be found. Jul 31 14:26:39.306508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:26:39.307640 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9af9bfe3-5794-4ea8-98d3-cdee0d078703 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Returning 404 to user: Instance e4f24854-1bcd-405b-9af8-fd3f3967d16b could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:26:39.307640 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9af9bfe3-5794-4ea8-98d3-cdee0d078703 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 404 len: 111 microversion: 2.1 time: 0.030189 Jul 31 14:26:39.307640 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 277/543] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:39 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:26:39.314333 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7ca0a741-ce5c-4934-9f7b-7837caf18dee tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '.version_select at 0x7f87e9ac1280>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:39.335190 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7ca0a741-ce5c-4934-9f7b-7837caf18dee tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-684727969" status: 202 len: 0 microversion: 2.1 time: 0.025430 Jul 31 14:26:39.335799 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 267/544] 10.222.0.40 () {58 vars in 1218 bytes} [Sun Jul 31 14:26:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-684727969 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:26:39.940247 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6c28bdf4-6ee1-44bf-9dc7-3c3bc42c9633 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:39.940881 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6c28bdf4-6ee1-44bf-9dc7-3c3bc42c9633 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:39.948068 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6c28bdf4-6ee1-44bf-9dc7-3c3bc42c9633 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:39.948521 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6c28bdf4-6ee1-44bf-9dc7-3c3bc42c9633 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:39.949288 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6c28bdf4-6ee1-44bf-9dc7-3c3bc42c9633 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:39.949727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6c28bdf4-6ee1-44bf-9dc7-3c3bc42c9633 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:40.086402 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6c28bdf4-6ee1-44bf-9dc7-3c3bc42c9633 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:40.087249 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-e49269c5-2b33-456c-a95c-a6fcc41c79ee tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Action: 'create', calling method: .version_select at 0x7f87e9a34940>, body: {"keypair": {"name": "tempest-keypair-1010088422", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0SbZwKixqr2yTN2x5YlVzz4nz3dmqEwZObKVbRjQQNzMkmVjdR5vbqd7RiEKH/2lXSa+g8D0uuc11jpSUdsheqnNSriAp/amYiewm6yi4wwMDS49H8/NvEIinfLFyRWQ=="}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:26:40.094193 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6c28bdf4-6ee1-44bf-9dc7-3c3bc42c9633 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1357 microversion: 2.1 time: 0.157960 Jul 31 14:26:40.094833 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 278/545] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:39 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:40.106971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-e49269c5-2b33-456c-a95c-a6fcc41c79ee tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Getting quotas for project 9097fd66951e457ba46812ff17db7501. Resources: {'key_pairs'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:26:40.111037 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-e49269c5-2b33-456c-a95c-a6fcc41c79ee tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Getting quotas for user d6e8399080a942f1b689fc8c6b42c717 and project 9097fd66951e457ba46812ff17db7501. Resources: {'key_pairs'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:26:40.137123 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-e49269c5-2b33-456c-a95c-a6fcc41c79ee tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053225 Jul 31 14:26:40.137893 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 268/546] 10.222.0.40 () {60 vars in 1159 bytes} [Sun Jul 31 14:26:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:26:41.116639 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9bbc10be-2c23-47b0-adc2-27900e1589b9 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:41.117194 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9bbc10be-2c23-47b0-adc2-27900e1589b9 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:41.123938 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9bbc10be-2c23-47b0-adc2-27900e1589b9 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:41.124498 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9bbc10be-2c23-47b0-adc2-27900e1589b9 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:41.125661 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9bbc10be-2c23-47b0-adc2-27900e1589b9 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:41.126359 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9bbc10be-2c23-47b0-adc2-27900e1589b9 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:41.273133 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9bbc10be-2c23-47b0-adc2-27900e1589b9 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:41.280992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9bbc10be-2c23-47b0-adc2-27900e1589b9 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1357 microversion: 2.1 time: 0.168997 Jul 31 14:26:41.281570 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 279/547] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:41 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:41.801078 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-828ab8c5-aaed-4b60-a40e-a134a80bd5d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-5347286", "imageRef": "57bc051a-64d0-4317-aa93-a7a2aed39369", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cbc0073a-ae55-48a9-8514-9052086eccf8"}], "security_groups": [{"name": "tempest-securitygroup--366644533"}], "key_name": "tempest-keypair-1010088422", "user_data": "}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:26:41.808985 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:26:41.911099 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.network.neutron [None req-828ab8c5-aaed-4b60-a40e-a134a80bd5d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] validate_networks() for [('cbc0073a-ae55-48a9-8514-9052086eccf8', None, None, None, None, None)] {{(pid=117781) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 14:26:42.267871 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-828ab8c5-aaed-4b60-a40e-a134a80bd5d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Flavor limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 14:26:42.268300 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-828ab8c5-aaed-4b60-a40e-a134a80bd5d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Image limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 14:26:42.268775 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-828ab8c5-aaed-4b60-a40e-a134a80bd5d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Flavor pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 14:26:42.269232 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-828ab8c5-aaed-4b60-a40e-a134a80bd5d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Image pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 14:26:42.269643 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-828ab8c5-aaed-4b60-a40e-a134a80bd5d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 14:26:42.278534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-828ab8c5-aaed-4b60-a40e-a134a80bd5d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:42.278985 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-828ab8c5-aaed-4b60-a40e-a134a80bd5d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:42.279815 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-828ab8c5-aaed-4b60-a40e-a134a80bd5d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:42.280256 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-828ab8c5-aaed-4b60-a40e-a134a80bd5d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:42.296489 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-828ab8c5-aaed-4b60-a40e-a134a80bd5d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Getting quotas for project 9097fd66951e457ba46812ff17db7501. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:26:42.301117 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-828ab8c5-aaed-4b60-a40e-a134a80bd5d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Getting quotas for user d6e8399080a942f1b689fc8c6b42c717 and project 9097fd66951e457ba46812ff17db7501. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:26:42.302626 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a5826dbe-43a6-422f-ade5-6fa267d1b65c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:42.303239 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a5826dbe-43a6-422f-ade5-6fa267d1b65c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:42.309609 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a5826dbe-43a6-422f-ade5-6fa267d1b65c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:42.310055 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a5826dbe-43a6-422f-ade5-6fa267d1b65c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:42.310815 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a5826dbe-43a6-422f-ade5-6fa267d1b65c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:42.311247 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a5826dbe-43a6-422f-ade5-6fa267d1b65c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:42.312530 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-828ab8c5-aaed-4b60-a40e-a134a80bd5d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Going to run 1 instances... {{(pid=117781) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 14:26:42.314909 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-828ab8c5-aaed-4b60-a40e-a134a80bd5d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57bc051a-64d0-4317-aa93-a7a2aed39369',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117781) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 14:26:42.360749 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-828ab8c5-aaed-4b60-a40e-a134a80bd5d5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.564549 Jul 31 14:26:42.361561 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 269/548] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Jul 31 14:26:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 14:26:42.372313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-f99aedef-1bd0-42f7-a9a9-942a3375a0ea tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:42.372927 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-f99aedef-1bd0-42f7-a9a9-942a3375a0ea tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:42.429963 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-f99aedef-1bd0-42f7-a9a9-942a3375a0ea tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:42.437638 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-f99aedef-1bd0-42f7-a9a9-942a3375a0ea tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07" status: 200 len: 1239 microversion: 2.1 time: 0.068975 Jul 31 14:26:42.451356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 270/549] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:42 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:26:42.458995 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a5826dbe-43a6-422f-ade5-6fa267d1b65c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:42.468510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a5826dbe-43a6-422f-ade5-6fa267d1b65c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1357 microversion: 2.1 time: 0.169953 Jul 31 14:26:42.469498 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 280/550] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:42 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:26:43.458272 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b650e90a-8b66-430a-9521-2b9d2d062542 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:43.458977 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b650e90a-8b66-430a-9521-2b9d2d062542 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:43.466065 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b650e90a-8b66-430a-9521-2b9d2d062542 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:43.466518 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b650e90a-8b66-430a-9521-2b9d2d062542 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:43.467303 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b650e90a-8b66-430a-9521-2b9d2d062542 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:43.467767 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b650e90a-8b66-430a-9521-2b9d2d062542 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:43.491568 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e9c78d27-a9fe-43d4-88db-148a2e522cb0 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:43.492785 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e9c78d27-a9fe-43d4-88db-148a2e522cb0 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:43.502876 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e9c78d27-a9fe-43d4-88db-148a2e522cb0 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:43.503397 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e9c78d27-a9fe-43d4-88db-148a2e522cb0 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:43.504221 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e9c78d27-a9fe-43d4-88db-148a2e522cb0 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:43.504658 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e9c78d27-a9fe-43d4-88db-148a2e522cb0 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:43.567798 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b650e90a-8b66-430a-9521-2b9d2d062542 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:43.579271 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b650e90a-8b66-430a-9521-2b9d2d062542 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07" status: 200 len: 1299 microversion: 2.1 time: 0.124964 Jul 31 14:26:43.592812 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 271/551] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:43 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 => generated 1299 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:43.678237 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e9c78d27-a9fe-43d4-88db-148a2e522cb0 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:43.686144 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e9c78d27-a9fe-43d4-88db-148a2e522cb0 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1357 microversion: 2.1 time: 0.198964 Jul 31 14:26:43.686724 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 281/552] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:43 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:43.705874 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-68f4527b-bc12-421a-9009-1bb2f9dc2d22 req-7c5922ea-1cb0-4e29-b931-784d7061b3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0fe7f8-51ab-4016-9142-4a9d2fda34a7", "name": "network-vif-plugged", "status": "completed", "tag": "2da882f0-72a7-499f-8313-43b198253581"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:26:43.718315 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-68f4527b-bc12-421a-9009-1bb2f9dc2d22 req-7c5922ea-1cb0-4e29-b931-784d7061b3f4 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:43.718769 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-68f4527b-bc12-421a-9009-1bb2f9dc2d22 req-7c5922ea-1cb0-4e29-b931-784d7061b3f4 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:43.730312 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-68f4527b-bc12-421a-9009-1bb2f9dc2d22 req-7c5922ea-1cb0-4e29-b931-784d7061b3f4 service nova] Creating event network-vif-plugged:2da882f0-72a7-499f-8313-43b198253581 for instance fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 on hv-cinder-84984 Jul 31 14:26:43.735065 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-68f4527b-bc12-421a-9009-1bb2f9dc2d22 req-7c5922ea-1cb0-4e29-b931-784d7061b3f4 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034409 Jul 31 14:26:43.735866 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 272/553] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:26:44.600339 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ffac03ed-e22a-4d87-844e-fa10bdf15157 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:44.600951 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ffac03ed-e22a-4d87-844e-fa10bdf15157 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:44.618206 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ffac03ed-e22a-4d87-844e-fa10bdf15157 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:44.618892 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ffac03ed-e22a-4d87-844e-fa10bdf15157 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:44.619688 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ffac03ed-e22a-4d87-844e-fa10bdf15157 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:44.620659 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ffac03ed-e22a-4d87-844e-fa10bdf15157 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:44.707788 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-3c8896a0-5a23-482b-868b-d9a7aba7b087 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:44.708521 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-3c8896a0-5a23-482b-868b-d9a7aba7b087 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:44.714979 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3c8896a0-5a23-482b-868b-d9a7aba7b087 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:44.715449 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3c8896a0-5a23-482b-868b-d9a7aba7b087 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:44.716278 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3c8896a0-5a23-482b-868b-d9a7aba7b087 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:44.716722 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3c8896a0-5a23-482b-868b-d9a7aba7b087 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:44.767132 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ffac03ed-e22a-4d87-844e-fa10bdf15157 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:44.774866 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ffac03ed-e22a-4d87-844e-fa10bdf15157 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07" status: 200 len: 1364 microversion: 2.1 time: 0.178284 Jul 31 14:26:44.775795 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 282/554] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:44 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:44.861068 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-3c8896a0-5a23-482b-868b-d9a7aba7b087 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:44.869204 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-3c8896a0-5a23-482b-868b-d9a7aba7b087 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1357 microversion: 2.1 time: 0.166554 Jul 31 14:26:44.869776 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 273/555] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:44 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:26:45.516626 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-7cc51d95-087c-406b-9f62-31e14662267b req-61a0b568-d349-40d7-8509-9d89ce41b635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b65263c9-40f6-48e3-9e44-b8654f688d07", "tag": "7e5cce5a-1a99-4a5c-bf5a-9f385c9918bc"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:26:45.526700 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-7cc51d95-087c-406b-9f62-31e14662267b req-61a0b568-d349-40d7-8509-9d89ce41b635 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:45.527187 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-7cc51d95-087c-406b-9f62-31e14662267b req-61a0b568-d349-40d7-8509-9d89ce41b635 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:45.538893 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-7cc51d95-087c-406b-9f62-31e14662267b req-61a0b568-d349-40d7-8509-9d89ce41b635 service nova] Creating event network-changed:7e5cce5a-1a99-4a5c-bf5a-9f385c9918bc for instance b65263c9-40f6-48e3-9e44-b8654f688d07 on hv-cinder-84984 Jul 31 14:26:45.543727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-7cc51d95-087c-406b-9f62-31e14662267b req-61a0b568-d349-40d7-8509-9d89ce41b635 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030888 Jul 31 14:26:45.544331 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 283/556] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:26:45.796727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-f165c507-4fe1-4df5-a841-873b75045b33 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:45.797299 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-f165c507-4fe1-4df5-a841-873b75045b33 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:45.803715 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f165c507-4fe1-4df5-a841-873b75045b33 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:45.804159 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f165c507-4fe1-4df5-a841-873b75045b33 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:45.804911 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f165c507-4fe1-4df5-a841-873b75045b33 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:45.805343 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f165c507-4fe1-4df5-a841-873b75045b33 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:45.892617 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-bbde154d-c9fa-4790-8ede-7cc2ecfbc145 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:45.893910 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-bbde154d-c9fa-4790-8ede-7cc2ecfbc145 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:45.902908 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bbde154d-c9fa-4790-8ede-7cc2ecfbc145 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:45.903358 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bbde154d-c9fa-4790-8ede-7cc2ecfbc145 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:45.904192 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bbde154d-c9fa-4790-8ede-7cc2ecfbc145 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:45.904632 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bbde154d-c9fa-4790-8ede-7cc2ecfbc145 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:45.942056 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-f165c507-4fe1-4df5-a841-873b75045b33 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:45.950011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-f165c507-4fe1-4df5-a841-873b75045b33 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07" status: 200 len: 1364 microversion: 2.1 time: 0.157098 Jul 31 14:26:45.950847 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 274/557] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:45 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:46.040158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bbde154d-c9fa-4790-8ede-7cc2ecfbc145 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:46.047983 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-bbde154d-c9fa-4790-8ede-7cc2ecfbc145 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1547 microversion: 2.1 time: 0.162322 Jul 31 14:26:46.048503 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 284/558] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:45 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:26:46.075622 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-e78db1a1-430f-46f6-a38b-61472ee33805 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:46.076242 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-e78db1a1-430f-46f6-a38b-61472ee33805 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:46.082861 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e78db1a1-430f-46f6-a38b-61472ee33805 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:46.083311 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e78db1a1-430f-46f6-a38b-61472ee33805 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:46.084110 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e78db1a1-430f-46f6-a38b-61472ee33805 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:46.084551 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e78db1a1-430f-46f6-a38b-61472ee33805 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:46.215974 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e78db1a1-430f-46f6-a38b-61472ee33805 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:46.224537 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-e78db1a1-430f-46f6-a38b-61472ee33805 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1547 microversion: 2.1 time: 0.153061 Jul 31 14:26:46.225105 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 275/559] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:46 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:46.244386 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1a7433b3-1ca2-48e3-bd99-250ac4674d06 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:46.249055 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1a7433b3-1ca2-48e3-bd99-250ac4674d06 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:46.249811 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1a7433b3-1ca2-48e3-bd99-250ac4674d06 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Searching by: {'deleted': False, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd'} {{(pid=117780) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 31 14:26:46.256429 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1a7433b3-1ca2-48e3-bd99-250ac4674d06 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:46.256868 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1a7433b3-1ca2-48e3-bd99-250ac4674d06 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:46.257659 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1a7433b3-1ca2-48e3-bd99-250ac4674d06 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:46.258090 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1a7433b3-1ca2-48e3-bd99-250ac4674d06 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:46.347074 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.multi_cell_list [None req-1a7433b3-1ca2-48e3-bd99-250ac4674d06 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117780) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 31 14:26:46.444514 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1a7433b3-1ca2-48e3-bd99-250ac4674d06 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.203804 Jul 31 14:26:46.445115 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 285/560] 10.222.0.40 () {58 vars in 1125 bytes} [Sun Jul 31 14:26:46 2022] GET /compute/v2.1/servers => generated 342 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:26:46.457451 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-21b556fe-7568-4009-a0bc-e9e0895a72d5 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:46.458070 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-21b556fe-7568-4009-a0bc-e9e0895a72d5 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:46.463937 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-21b556fe-7568-4009-a0bc-e9e0895a72d5 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:46.464389 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-21b556fe-7568-4009-a0bc-e9e0895a72d5 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:46.465156 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-21b556fe-7568-4009-a0bc-e9e0895a72d5 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:46.465609 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-21b556fe-7568-4009-a0bc-e9e0895a72d5 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:46.590931 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-21b556fe-7568-4009-a0bc-e9e0895a72d5 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:46.598416 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-21b556fe-7568-4009-a0bc-e9e0895a72d5 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1547 microversion: 2.1 time: 0.145630 Jul 31 14:26:46.598924 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 276/561] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:46 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1547 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:46.972257 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f30e5514-79d6-4731-94a8-ac66d9477d5e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:46.972781 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f30e5514-79d6-4731-94a8-ac66d9477d5e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:46.979246 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f30e5514-79d6-4731-94a8-ac66d9477d5e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:46.979736 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f30e5514-79d6-4731-94a8-ac66d9477d5e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:46.980523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f30e5514-79d6-4731-94a8-ac66d9477d5e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:46.980959 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f30e5514-79d6-4731-94a8-ac66d9477d5e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:47.119559 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f30e5514-79d6-4731-94a8-ac66d9477d5e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:47.129002 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f30e5514-79d6-4731-94a8-ac66d9477d5e tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07" status: 200 len: 1364 microversion: 2.1 time: 0.161702 Jul 31 14:26:47.130149 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 286/562] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:46 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:47.260118 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-1952833b-1af8-4c35-929d-1ecd3f4e118d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:26:47.262478 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-1952833b-1af8-4c35-929d-1ecd3f4e118d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:47.270979 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1952833b-1af8-4c35-929d-1ecd3f4e118d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:47.271475 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1952833b-1af8-4c35-929d-1ecd3f4e118d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:47.272250 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1952833b-1af8-4c35-929d-1ecd3f4e118d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:47.272687 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1952833b-1af8-4c35-929d-1ecd3f4e118d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:47.296891 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.objects.instance [None req-1952833b-1af8-4c35-929d-1ecd3f4e118d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lazy-loading 'flavor' on Instance uuid 337cbeb6-512e-4bf5-bd53-cd837c00947e {{(pid=117781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:26:47.407038 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:26:47.417941 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-1952833b-1af8-4c35-929d-1ecd3f4e118d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "POST /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e/action" status: 200 len: 32 microversion: 2.1 time: 0.163453 Jul 31 14:26:47.418547 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 277/563] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Jul 31 14:26:47 2022] POST /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 14:26:47.428760 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2bb6b8d7-4c28-4a6f-8cab-ace565bd5d79 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:47.429470 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2bb6b8d7-4c28-4a6f-8cab-ace565bd5d79 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:47.435440 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2bb6b8d7-4c28-4a6f-8cab-ace565bd5d79 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:47.435908 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2bb6b8d7-4c28-4a6f-8cab-ace565bd5d79 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:47.436657 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2bb6b8d7-4c28-4a6f-8cab-ace565bd5d79 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:47.437085 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2bb6b8d7-4c28-4a6f-8cab-ace565bd5d79 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:47.565197 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2bb6b8d7-4c28-4a6f-8cab-ace565bd5d79 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:47.573099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2bb6b8d7-4c28-4a6f-8cab-ace565bd5d79 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1736 microversion: 2.1 time: 0.148973 Jul 31 14:26:47.573664 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 287/564] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:47 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:48.151528 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-638d6a4c-7ec8-48a0-b007-443d5b8ad494 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:48.152315 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-638d6a4c-7ec8-48a0-b007-443d5b8ad494 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:48.153999 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c90025a2-f24e-4561-b5e4-7707267d99db tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bf6503c-44e6-4c33-894b-09afb72e0fc6"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:26:48.156424 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c90025a2-f24e-4561-b5e4-7707267d99db tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:48.158599 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-638d6a4c-7ec8-48a0-b007-443d5b8ad494 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:48.159045 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-638d6a4c-7ec8-48a0-b007-443d5b8ad494 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:48.159840 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-638d6a4c-7ec8-48a0-b007-443d5b8ad494 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:48.160275 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-638d6a4c-7ec8-48a0-b007-443d5b8ad494 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:48.162785 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c90025a2-f24e-4561-b5e4-7707267d99db tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:48.163234 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c90025a2-f24e-4561-b5e4-7707267d99db tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:48.164035 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c90025a2-f24e-4561-b5e4-7707267d99db tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:48.164473 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c90025a2-f24e-4561-b5e4-7707267d99db tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:48.291053 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-638d6a4c-7ec8-48a0-b007-443d5b8ad494 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:48.299543 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-638d6a4c-7ec8-48a0-b007-443d5b8ad494 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07" status: 200 len: 1364 microversion: 2.1 time: 0.152666 Jul 31 14:26:48.301024 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 278/565] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:48 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:48.488875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c90025a2-f24e-4561-b5e4-7707267d99db tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "POST /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.338682 Jul 31 14:26:48.489610 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 288/566] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Jul 31 14:26:48 2022] POST /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:26:48.594443 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-42bf8092-8009-4a2c-81f3-0cf7dd20849e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:48.595063 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-42bf8092-8009-4a2c-81f3-0cf7dd20849e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:48.601384 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-42bf8092-8009-4a2c-81f3-0cf7dd20849e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:48.601832 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-42bf8092-8009-4a2c-81f3-0cf7dd20849e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:48.602629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-42bf8092-8009-4a2c-81f3-0cf7dd20849e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:48.603096 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-42bf8092-8009-4a2c-81f3-0cf7dd20849e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:48.802504 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-42bf8092-8009-4a2c-81f3-0cf7dd20849e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:48.810426 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-42bf8092-8009-4a2c-81f3-0cf7dd20849e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1736 microversion: 2.1 time: 0.219951 Jul 31 14:26:48.811005 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 279/567] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:48 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1736 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:49.323981 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c0127fe3-5d87-4b35-868d-0e53666b0af1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:49.324585 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c0127fe3-5d87-4b35-868d-0e53666b0af1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:49.331013 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c0127fe3-5d87-4b35-868d-0e53666b0af1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:49.332056 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c0127fe3-5d87-4b35-868d-0e53666b0af1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:49.332808 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c0127fe3-5d87-4b35-868d-0e53666b0af1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:49.333241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c0127fe3-5d87-4b35-868d-0e53666b0af1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:49.337234 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:26:49.464742 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c0127fe3-5d87-4b35-868d-0e53666b0af1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:49.472053 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c0127fe3-5d87-4b35-868d-0e53666b0af1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07" status: 200 len: 1364 microversion: 2.1 time: 0.152893 Jul 31 14:26:49.472639 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 289/568] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:49 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:49.832170 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-e8bea336-36e4-46f1-be38-7ab62553336b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:49.832717 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-e8bea336-36e4-46f1-be38-7ab62553336b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:49.839391 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e8bea336-36e4-46f1-be38-7ab62553336b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:49.839866 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e8bea336-36e4-46f1-be38-7ab62553336b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:49.840619 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e8bea336-36e4-46f1-be38-7ab62553336b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:49.841048 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e8bea336-36e4-46f1-be38-7ab62553336b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:49.975940 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e8bea336-36e4-46f1-be38-7ab62553336b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:49.983965 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-e8bea336-36e4-46f1-be38-7ab62553336b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1736 microversion: 2.1 time: 0.155724 Jul 31 14:26:49.984538 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 280/569] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:49 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:50.492713 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-823793d4-dfa9-4968-9f37-8bfb891e0e6b tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:50.493327 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-823793d4-dfa9-4968-9f37-8bfb891e0e6b tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:50.499834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-823793d4-dfa9-4968-9f37-8bfb891e0e6b tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:50.500281 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-823793d4-dfa9-4968-9f37-8bfb891e0e6b tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:50.501042 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-823793d4-dfa9-4968-9f37-8bfb891e0e6b tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:50.501483 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-823793d4-dfa9-4968-9f37-8bfb891e0e6b tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:50.633291 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-823793d4-dfa9-4968-9f37-8bfb891e0e6b tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:50.640626 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-823793d4-dfa9-4968-9f37-8bfb891e0e6b tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07" status: 200 len: 1364 microversion: 2.1 time: 0.151735 Jul 31 14:26:50.641186 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 290/570] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:50 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:51.006666 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-6cb96780-691f-4b86-803a-b742fe041034 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:51.007305 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-6cb96780-691f-4b86-803a-b742fe041034 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:51.013782 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6cb96780-691f-4b86-803a-b742fe041034 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:51.014236 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6cb96780-691f-4b86-803a-b742fe041034 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:51.015009 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6cb96780-691f-4b86-803a-b742fe041034 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:51.015475 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6cb96780-691f-4b86-803a-b742fe041034 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:51.146411 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-6cb96780-691f-4b86-803a-b742fe041034 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:51.154350 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-6cb96780-691f-4b86-803a-b742fe041034 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1736 microversion: 2.1 time: 0.152422 Jul 31 14:26:51.154947 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 281/571] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:51 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:51.662027 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f742bccc-17ad-42c8-91ff-dfc0dac8c5b3 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:51.662646 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f742bccc-17ad-42c8-91ff-dfc0dac8c5b3 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:51.669235 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f742bccc-17ad-42c8-91ff-dfc0dac8c5b3 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:51.669886 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f742bccc-17ad-42c8-91ff-dfc0dac8c5b3 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:51.670459 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f742bccc-17ad-42c8-91ff-dfc0dac8c5b3 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:51.670899 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f742bccc-17ad-42c8-91ff-dfc0dac8c5b3 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:51.738700 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-a4a09637-d338-4c83-bd98-3f1afc302d17 req-372bb6ea-7e30-478d-9b0e-215cb54cfdaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65263c9-40f6-48e3-9e44-b8654f688d07", "name": "network-vif-plugged", "status": "completed", "tag": "7e5cce5a-1a99-4a5c-bf5a-9f385c9918bc"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:26:51.749879 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-a4a09637-d338-4c83-bd98-3f1afc302d17 req-372bb6ea-7e30-478d-9b0e-215cb54cfdaa service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:51.750415 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-a4a09637-d338-4c83-bd98-3f1afc302d17 req-372bb6ea-7e30-478d-9b0e-215cb54cfdaa service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:51.761755 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-a4a09637-d338-4c83-bd98-3f1afc302d17 req-372bb6ea-7e30-478d-9b0e-215cb54cfdaa service nova] Creating event network-vif-plugged:7e5cce5a-1a99-4a5c-bf5a-9f385c9918bc for instance b65263c9-40f6-48e3-9e44-b8654f688d07 on hv-cinder-84984 Jul 31 14:26:51.766525 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-a4a09637-d338-4c83-bd98-3f1afc302d17 req-372bb6ea-7e30-478d-9b0e-215cb54cfdaa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035324 Jul 31 14:26:51.767284 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 282/572] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:26:51.809034 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f742bccc-17ad-42c8-91ff-dfc0dac8c5b3 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:51.816652 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f742bccc-17ad-42c8-91ff-dfc0dac8c5b3 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07" status: 200 len: 1364 microversion: 2.1 time: 0.158973 Jul 31 14:26:51.817230 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 291/573] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:51 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:52.176586 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-585cb83d-dd00-427a-9a57-992697c1e8e2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:52.177274 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-585cb83d-dd00-427a-9a57-992697c1e8e2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:52.183458 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-585cb83d-dd00-427a-9a57-992697c1e8e2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:52.183906 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-585cb83d-dd00-427a-9a57-992697c1e8e2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:52.184661 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-585cb83d-dd00-427a-9a57-992697c1e8e2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:52.185089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-585cb83d-dd00-427a-9a57-992697c1e8e2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:52.287258 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:26:52.313316 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-585cb83d-dd00-427a-9a57-992697c1e8e2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:52.321611 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-585cb83d-dd00-427a-9a57-992697c1e8e2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1736 microversion: 2.1 time: 0.149789 Jul 31 14:26:52.322170 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 283/574] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:52 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:52.837275 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f9cbaa01-5369-4c99-8985-856daf87a2e2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:52.837879 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f9cbaa01-5369-4c99-8985-856daf87a2e2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:52.844293 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f9cbaa01-5369-4c99-8985-856daf87a2e2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:52.844734 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f9cbaa01-5369-4c99-8985-856daf87a2e2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:52.845481 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f9cbaa01-5369-4c99-8985-856daf87a2e2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:52.845908 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f9cbaa01-5369-4c99-8985-856daf87a2e2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:52.976385 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f9cbaa01-5369-4c99-8985-856daf87a2e2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:52.983716 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f9cbaa01-5369-4c99-8985-856daf87a2e2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07" status: 200 len: 1364 microversion: 2.1 time: 0.150251 Jul 31 14:26:52.984284 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 292/575] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:52 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:53.342726 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-345da09b-ed0e-49b2-80db-2c2306dff12c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:53.343336 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-345da09b-ed0e-49b2-80db-2c2306dff12c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:53.345196 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=12 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:26:53.351600 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-345da09b-ed0e-49b2-80db-2c2306dff12c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:53.352163 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-345da09b-ed0e-49b2-80db-2c2306dff12c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:53.352974 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-345da09b-ed0e-49b2-80db-2c2306dff12c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:53.353417 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-345da09b-ed0e-49b2-80db-2c2306dff12c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:53.479995 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-345da09b-ed0e-49b2-80db-2c2306dff12c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:53.487981 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-345da09b-ed0e-49b2-80db-2c2306dff12c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1736 microversion: 2.1 time: 0.149132 Jul 31 14:26:53.488557 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 284/576] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:53 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:54.005563 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-83254da8-9fde-4cd8-96d3-a3f9bf845b30 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:54.006206 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-83254da8-9fde-4cd8-96d3-a3f9bf845b30 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:54.012689 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-83254da8-9fde-4cd8-96d3-a3f9bf845b30 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:54.013136 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-83254da8-9fde-4cd8-96d3-a3f9bf845b30 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:54.013899 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-83254da8-9fde-4cd8-96d3-a3f9bf845b30 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:54.014338 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-83254da8-9fde-4cd8-96d3-a3f9bf845b30 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:54.154297 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-83254da8-9fde-4cd8-96d3-a3f9bf845b30 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:54.161978 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-83254da8-9fde-4cd8-96d3-a3f9bf845b30 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07" status: 200 len: 1364 microversion: 2.1 time: 0.160767 Jul 31 14:26:54.162550 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 293/577] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:54 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:54.509358 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7b2dfc7f-0243-4696-9f2f-ff539ebb7502 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:54.510220 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7b2dfc7f-0243-4696-9f2f-ff539ebb7502 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:54.516649 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7b2dfc7f-0243-4696-9f2f-ff539ebb7502 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:54.517096 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7b2dfc7f-0243-4696-9f2f-ff539ebb7502 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:54.517857 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7b2dfc7f-0243-4696-9f2f-ff539ebb7502 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:54.518303 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7b2dfc7f-0243-4696-9f2f-ff539ebb7502 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:54.648578 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7b2dfc7f-0243-4696-9f2f-ff539ebb7502 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:54.657471 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7b2dfc7f-0243-4696-9f2f-ff539ebb7502 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1736 microversion: 2.1 time: 0.151948 Jul 31 14:26:54.658053 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 285/578] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:54 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:55.182117 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ef425a05-75ef-46c1-a2a8-8c8d73909900 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:55.182778 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ef425a05-75ef-46c1-a2a8-8c8d73909900 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:55.189317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ef425a05-75ef-46c1-a2a8-8c8d73909900 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:55.189764 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ef425a05-75ef-46c1-a2a8-8c8d73909900 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:55.191172 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ef425a05-75ef-46c1-a2a8-8c8d73909900 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:55.191636 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ef425a05-75ef-46c1-a2a8-8c8d73909900 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:55.330935 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ef425a05-75ef-46c1-a2a8-8c8d73909900 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:55.340833 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ef425a05-75ef-46c1-a2a8-8c8d73909900 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07" status: 200 len: 1554 microversion: 2.1 time: 0.162460 Jul 31 14:26:55.341438 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 294/579] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:55 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:26:55.365714 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-547e4914-ca06-4933-9204-4633fcbc6df0 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:55.366072 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-547e4914-ca06-4933-9204-4633fcbc6df0 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:55.373452 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-547e4914-ca06-4933-9204-4633fcbc6df0 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:55.374083 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-547e4914-ca06-4933-9204-4633fcbc6df0 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:55.375051 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-547e4914-ca06-4933-9204-4633fcbc6df0 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:55.375738 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-547e4914-ca06-4933-9204-4633fcbc6df0 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:55.475535 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-547e4914-ca06-4933-9204-4633fcbc6df0 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114611 Jul 31 14:26:55.476128 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 286/580] 10.222.0.40 () {58 vars in 1275 bytes} [Sun Jul 31 14:26:55 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:26:55.678885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3dd8cf85-a67f-45d2-a1fb-ad354d15ce58 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:55.679824 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3dd8cf85-a67f-45d2-a1fb-ad354d15ce58 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:55.686447 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3dd8cf85-a67f-45d2-a1fb-ad354d15ce58 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:55.687186 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3dd8cf85-a67f-45d2-a1fb-ad354d15ce58 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:55.688206 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3dd8cf85-a67f-45d2-a1fb-ad354d15ce58 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:55.688650 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3dd8cf85-a67f-45d2-a1fb-ad354d15ce58 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:55.936640 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3dd8cf85-a67f-45d2-a1fb-ad354d15ce58 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:55.945140 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3dd8cf85-a67f-45d2-a1fb-ad354d15ce58 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1736 microversion: 2.1 time: 0.270838 Jul 31 14:26:55.945723 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 295/581] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:55 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1736 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:56.100065 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-46474378-e0e2-46df-83df-f52a3b32542e tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:56.100676 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-46474378-e0e2-46df-83df-f52a3b32542e tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:56.106639 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-46474378-e0e2-46df-83df-f52a3b32542e tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:56.107089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-46474378-e0e2-46df-83df-f52a3b32542e tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:56.107882 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-46474378-e0e2-46df-83df-f52a3b32542e tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:56.108326 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-46474378-e0e2-46df-83df-f52a3b32542e tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:56.240101 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-46474378-e0e2-46df-83df-f52a3b32542e tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:56.248253 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-46474378-e0e2-46df-83df-f52a3b32542e tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1593 microversion: 2.1 time: 0.152707 Jul 31 14:26:56.249142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 287/582] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:56 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1593 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:56.538089 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-fbd379c9-f91a-425f-891d-c5e89e4951f8 req-db5ea4b7-d080-4996-8734-72ab9c367bfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b65263c9-40f6-48e3-9e44-b8654f688d07", "tag": "7e5cce5a-1a99-4a5c-bf5a-9f385c9918bc"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:26:56.548457 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:26:56.551911 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-fbd379c9-f91a-425f-891d-c5e89e4951f8 req-db5ea4b7-d080-4996-8734-72ab9c367bfb service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:56.552732 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-fbd379c9-f91a-425f-891d-c5e89e4951f8 req-db5ea4b7-d080-4996-8734-72ab9c367bfb service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:56.567004 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-fbd379c9-f91a-425f-891d-c5e89e4951f8 req-db5ea4b7-d080-4996-8734-72ab9c367bfb service nova] Creating event network-changed:7e5cce5a-1a99-4a5c-bf5a-9f385c9918bc for instance b65263c9-40f6-48e3-9e44-b8654f688d07 on hv-cinder-84984 Jul 31 14:26:56.573652 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-fbd379c9-f91a-425f-891d-c5e89e4951f8 req-db5ea4b7-d080-4996-8734-72ab9c367bfb service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041178 Jul 31 14:26:56.575043 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 296/583] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:26:56.967127 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-161b01dd-bd41-4049-9a61-fbec0e1362b7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:56.967756 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-161b01dd-bd41-4049-9a61-fbec0e1362b7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:56.974750 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-161b01dd-bd41-4049-9a61-fbec0e1362b7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:56.975379 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-161b01dd-bd41-4049-9a61-fbec0e1362b7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:56.976177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-161b01dd-bd41-4049-9a61-fbec0e1362b7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:56.976606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-161b01dd-bd41-4049-9a61-fbec0e1362b7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:57.321808 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-161b01dd-bd41-4049-9a61-fbec0e1362b7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:57.332417 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-161b01dd-bd41-4049-9a61-fbec0e1362b7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1736 microversion: 2.1 time: 0.368997 Jul 31 14:26:57.340171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 288/584] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:56 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1736 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:58.355748 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0b3741a7-5cdc-4a94-b612-1d73063317e8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:58.356435 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0b3741a7-5cdc-4a94-b612-1d73063317e8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:58.363195 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0b3741a7-5cdc-4a94-b612-1d73063317e8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:58.363654 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0b3741a7-5cdc-4a94-b612-1d73063317e8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:58.364601 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0b3741a7-5cdc-4a94-b612-1d73063317e8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:58.365025 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0b3741a7-5cdc-4a94-b612-1d73063317e8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:58.501251 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0b3741a7-5cdc-4a94-b612-1d73063317e8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:58.509945 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0b3741a7-5cdc-4a94-b612-1d73063317e8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1736 microversion: 2.1 time: 0.159073 Jul 31 14:26:58.510613 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 297/585] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:58 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:58.715120 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-acad00c5-b808-4c62-896d-baeb3ecb9f6a req-111500cd-29dc-47b9-abea-cc69b6a0061a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb0fe7f8-51ab-4016-9142-4a9d2fda34a7", "tag": "2da882f0-72a7-499f-8313-43b198253581"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:26:58.726203 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-acad00c5-b808-4c62-896d-baeb3ecb9f6a req-111500cd-29dc-47b9-abea-cc69b6a0061a service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:58.726641 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-acad00c5-b808-4c62-896d-baeb3ecb9f6a req-111500cd-29dc-47b9-abea-cc69b6a0061a service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:58.739482 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-acad00c5-b808-4c62-896d-baeb3ecb9f6a req-111500cd-29dc-47b9-abea-cc69b6a0061a service nova] Creating event network-changed:2da882f0-72a7-499f-8313-43b198253581 for instance fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 on hv-cinder-84984 Jul 31 14:26:58.744574 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-acad00c5-b808-4c62-896d-baeb3ecb9f6a req-111500cd-29dc-47b9-abea-cc69b6a0061a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033101 Jul 31 14:26:58.745264 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 289/586] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:26:59.531341 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-99c658b9-753e-4256-a694-4ca66816c5d3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:26:59.532529 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-99c658b9-753e-4256-a694-4ca66816c5d3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:59.539163 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-99c658b9-753e-4256-a694-4ca66816c5d3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:59.539725 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-99c658b9-753e-4256-a694-4ca66816c5d3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:59.540503 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-99c658b9-753e-4256-a694-4ca66816c5d3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:59.540943 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-99c658b9-753e-4256-a694-4ca66816c5d3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:59.726589 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-99c658b9-753e-4256-a694-4ca66816c5d3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:26:59.736758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-99c658b9-753e-4256-a694-4ca66816c5d3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1736 microversion: 2.1 time: 0.208786 Jul 31 14:26:59.737991 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 298/587] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:26:59 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:26:59.791555 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-0e326a17-470d-4a63-afaf-7909174043d1 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-402018921"}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:26:59.792186 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-0e326a17-470d-4a63-afaf-7909174043d1 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:26:59.798829 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0e326a17-470d-4a63-afaf-7909174043d1 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:59.799359 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0e326a17-470d-4a63-afaf-7909174043d1 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:59.800779 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0e326a17-470d-4a63-afaf-7909174043d1 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:26:59.801296 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0e326a17-470d-4a63-afaf-7909174043d1 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:26:59.937948 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.network.security_group_api [None req-0e326a17-470d-4a63-afaf-7909174043d1 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Adding security group 372ee9d5-843c-4213-9990-b78b9ccb5c27 to port 2da882f0-72a7-499f-8313-43b198253581 Jul 31 14:27:00.252899 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-0e326a17-470d-4a63-afaf-7909174043d1 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "POST /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7/action" status: 202 len: 0 microversion: 2.1 time: 0.466198 Jul 31 14:27:00.253504 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 290/588] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Jul 31 14:26:59 2022] POST /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:27:00.261587 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e4af0768-f760-497d-a309-e68b3fcdbc49 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:00.262315 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e4af0768-f760-497d-a309-e68b3fcdbc49 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:00.268923 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e4af0768-f760-497d-a309-e68b3fcdbc49 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:00.269372 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e4af0768-f760-497d-a309-e68b3fcdbc49 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:00.270165 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e4af0768-f760-497d-a309-e68b3fcdbc49 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:00.270607 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e4af0768-f760-497d-a309-e68b3fcdbc49 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:00.423371 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e4af0768-f760-497d-a309-e68b3fcdbc49 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:00.431397 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e4af0768-f760-497d-a309-e68b3fcdbc49 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1758 microversion: 2.1 time: 0.173787 Jul 31 14:27:00.432205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 299/589] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:00 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:00.760202 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-32b3a92d-959b-4034-9ac1-fa8ff15863ee tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:00.760530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-99d090e9-e162-4d7d-ac75-a84451637ffc req-f13ce010-d84e-468c-ae50-96e348e1b1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb0fe7f8-51ab-4016-9142-4a9d2fda34a7", "tag": "2da882f0-72a7-499f-8313-43b198253581"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:27:00.761795 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-32b3a92d-959b-4034-9ac1-fa8ff15863ee tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:00.769033 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-32b3a92d-959b-4034-9ac1-fa8ff15863ee tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:00.769491 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-32b3a92d-959b-4034-9ac1-fa8ff15863ee tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:00.770267 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-32b3a92d-959b-4034-9ac1-fa8ff15863ee tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:00.770887 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-32b3a92d-959b-4034-9ac1-fa8ff15863ee tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:00.771591 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-99d090e9-e162-4d7d-ac75-a84451637ffc req-f13ce010-d84e-468c-ae50-96e348e1b1c7 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:00.772109 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-99d090e9-e162-4d7d-ac75-a84451637ffc req-f13ce010-d84e-468c-ae50-96e348e1b1c7 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:00.783790 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-99d090e9-e162-4d7d-ac75-a84451637ffc req-f13ce010-d84e-468c-ae50-96e348e1b1c7 service nova] Creating event network-changed:2da882f0-72a7-499f-8313-43b198253581 for instance fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 on hv-cinder-84984 Jul 31 14:27:00.789150 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-99d090e9-e162-4d7d-ac75-a84451637ffc req-f13ce010-d84e-468c-ae50-96e348e1b1c7 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032167 Jul 31 14:27:00.789858 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 300/590] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:27:00.945988 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-32b3a92d-959b-4034-9ac1-fa8ff15863ee tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:00.954428 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-32b3a92d-959b-4034-9ac1-fa8ff15863ee tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1736 microversion: 2.1 time: 0.198514 Jul 31 14:27:00.954936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 291/591] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:00 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1736 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:01.977246 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-563790c9-6908-49b3-b404-151f1d7927d8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:01.978003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-563790c9-6908-49b3-b404-151f1d7927d8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:01.984276 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-563790c9-6908-49b3-b404-151f1d7927d8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:01.984712 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-563790c9-6908-49b3-b404-151f1d7927d8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:01.985467 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-563790c9-6908-49b3-b404-151f1d7927d8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:01.985903 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-563790c9-6908-49b3-b404-151f1d7927d8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:02.115223 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-563790c9-6908-49b3-b404-151f1d7927d8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:02.123072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-563790c9-6908-49b3-b404-151f1d7927d8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1736 microversion: 2.1 time: 0.150481 Jul 31 14:27:02.123670 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 301/592] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:01 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:02.855164 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-cf85c772-a7bc-4779-8042-92277aa03eb2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:02.855743 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-cf85c772-a7bc-4779-8042-92277aa03eb2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:02.862885 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-cf85c772-a7bc-4779-8042-92277aa03eb2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:02.863343 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-cf85c772-a7bc-4779-8042-92277aa03eb2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:02.864206 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-cf85c772-a7bc-4779-8042-92277aa03eb2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:02.864644 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-cf85c772-a7bc-4779-8042-92277aa03eb2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:02.896808 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-cf85c772-a7bc-4779-8042-92277aa03eb2 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81/os-volume_attachments/1905e150-6307-4893-b067-d5cee9922c73" status: 200 len: 194 microversion: 2.20 time: 0.045531 Jul 31 14:27:02.897432 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 292/593] 10.222.0.40 () {60 vars in 1454 bytes} [Sun Jul 31 14:27:02 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81/os-volume_attachments/1905e150-6307-4893-b067-d5cee9922c73 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 14:27:02.966332 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d142ab51-8cfe-42b9-91f1-eaced4bd78ff tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:02.966828 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d142ab51-8cfe-42b9-91f1-eaced4bd78ff tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:02.968814 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=66 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:27:02.975175 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d142ab51-8cfe-42b9-91f1-eaced4bd78ff tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:02.975656 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d142ab51-8cfe-42b9-91f1-eaced4bd78ff tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:02.976424 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d142ab51-8cfe-42b9-91f1-eaced4bd78ff tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:02.977030 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d142ab51-8cfe-42b9-91f1-eaced4bd78ff tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:03.058764 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-d142ab51-8cfe-42b9-91f1-eaced4bd78ff tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lazy-loading 'services' on Instance uuid d0810b36-49ee-482b-9e65-f587148b2a81 {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:27:03.137624 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d142ab51-8cfe-42b9-91f1-eaced4bd78ff tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81/os-volume_attachments/1905e150-6307-4893-b067-d5cee9922c73" status: 202 len: 0 microversion: 2.20 time: 0.175080 Jul 31 14:27:03.139702 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 302/594] 10.222.0.40 () {60 vars in 1457 bytes} [Sun Jul 31 14:27:02 2022] DELETE /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81/os-volume_attachments/1905e150-6307-4893-b067-d5cee9922c73 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 14:27:03.147698 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2c1add92-fd0c-4281-abd9-0556b23ccef4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:03.147983 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-f5ac5032-f349-45ca-811a-80a10dd60914 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:03.148628 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-f5ac5032-f349-45ca-811a-80a10dd60914 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:03.150018 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2c1add92-fd0c-4281-abd9-0556b23ccef4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:03.154996 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f5ac5032-f349-45ca-811a-80a10dd60914 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:03.155565 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f5ac5032-f349-45ca-811a-80a10dd60914 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:03.156525 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f5ac5032-f349-45ca-811a-80a10dd60914 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:03.156734 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2c1add92-fd0c-4281-abd9-0556b23ccef4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:03.156976 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f5ac5032-f349-45ca-811a-80a10dd60914 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:03.157349 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2c1add92-fd0c-4281-abd9-0556b23ccef4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:03.158071 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2c1add92-fd0c-4281-abd9-0556b23ccef4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:03.158460 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2c1add92-fd0c-4281-abd9-0556b23ccef4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:03.189176 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2c1add92-fd0c-4281-abd9-0556b23ccef4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046047 Jul 31 14:27:03.193882 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 303/595] 10.222.0.40 () {60 vars in 1343 bytes} [Sun Jul 31 14:27:03 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 14:27:03.296594 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-f5ac5032-f349-45ca-811a-80a10dd60914 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:03.304529 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-f5ac5032-f349-45ca-811a-80a10dd60914 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1736 microversion: 2.1 time: 0.163768 Jul 31 14:27:03.305111 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 293/596] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:03 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:04.201972 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3b3e6e2d-d371-4999-b60e-88edcb0522fc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:04.204153 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3b3e6e2d-d371-4999-b60e-88edcb0522fc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:04.210973 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3b3e6e2d-d371-4999-b60e-88edcb0522fc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:04.211409 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3b3e6e2d-d371-4999-b60e-88edcb0522fc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:04.212234 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3b3e6e2d-d371-4999-b60e-88edcb0522fc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:04.212659 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3b3e6e2d-d371-4999-b60e-88edcb0522fc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:04.243341 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3b3e6e2d-d371-4999-b60e-88edcb0522fc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045475 Jul 31 14:27:04.244167 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 304/597] 10.222.0.40 () {60 vars in 1343 bytes} [Sun Jul 31 14:27:04 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:04.308168 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-ba86701e-cc05-4b03-9061-aa8e04a7467e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:04.308671 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-ba86701e-cc05-4b03-9061-aa8e04a7467e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:04.315750 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ba86701e-cc05-4b03-9061-aa8e04a7467e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:04.316203 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ba86701e-cc05-4b03-9061-aa8e04a7467e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:04.316968 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ba86701e-cc05-4b03-9061-aa8e04a7467e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:04.317536 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ba86701e-cc05-4b03-9061-aa8e04a7467e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:04.325809 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0c2d7443-70d5-4eed-904c-76c36ce94fd3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:04.326410 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0c2d7443-70d5-4eed-904c-76c36ce94fd3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:04.332972 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0c2d7443-70d5-4eed-904c-76c36ce94fd3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:04.333416 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0c2d7443-70d5-4eed-904c-76c36ce94fd3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:04.334168 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0c2d7443-70d5-4eed-904c-76c36ce94fd3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:04.334595 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0c2d7443-70d5-4eed-904c-76c36ce94fd3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:04.343443 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-ba86701e-cc05-4b03-9061-aa8e04a7467e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Going to try to terminate instance {{(pid=117781) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 14:27:04.392892 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:27:04.421493 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-ba86701e-cc05-4b03-9061-aa8e04a7467e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 204 len: 0 microversion: 2.20 time: 0.116529 Jul 31 14:27:04.422310 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 294/598] 10.222.0.40 () {60 vars in 1280 bytes} [Sun Jul 31 14:27:04 2022] DELETE /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 14:27:04.431060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-8ae50984-b7e9-45e9-8cc6-0ea9baf51823 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:04.432365 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-8ae50984-b7e9-45e9-8cc6-0ea9baf51823 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:04.438347 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8ae50984-b7e9-45e9-8cc6-0ea9baf51823 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:04.438802 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8ae50984-b7e9-45e9-8cc6-0ea9baf51823 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:04.439609 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8ae50984-b7e9-45e9-8cc6-0ea9baf51823 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:04.440541 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8ae50984-b7e9-45e9-8cc6-0ea9baf51823 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:04.465427 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0c2d7443-70d5-4eed-904c-76c36ce94fd3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:04.473282 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0c2d7443-70d5-4eed-904c-76c36ce94fd3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1736 microversion: 2.1 time: 0.151473 Jul 31 14:27:04.473847 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 305/599] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:04 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:27:04.573640 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-8ae50984-b7e9-45e9-8cc6-0ea9baf51823 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:04.582464 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-8ae50984-b7e9-45e9-8cc6-0ea9baf51823 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:04.584021 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-8ae50984-b7e9-45e9-8cc6-0ea9baf51823 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:04.585177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-8ae50984-b7e9-45e9-8cc6-0ea9baf51823 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1724 microversion: 2.20 time: 0.158208 Jul 31 14:27:04.585741 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 295/600] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:27:04 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:27:05.494226 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6e852253-7b42-41e1-bb83-591b150950d6 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:05.494784 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6e852253-7b42-41e1-bb83-591b150950d6 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:05.501257 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6e852253-7b42-41e1-bb83-591b150950d6 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:05.501707 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6e852253-7b42-41e1-bb83-591b150950d6 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:05.502469 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6e852253-7b42-41e1-bb83-591b150950d6 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:05.502905 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6e852253-7b42-41e1-bb83-591b150950d6 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:05.521535 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:27:05.608168 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-192c19ec-050b-489d-a48a-c7281c46c3cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:05.608778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-192c19ec-050b-489d-a48a-c7281c46c3cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:05.614821 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-192c19ec-050b-489d-a48a-c7281c46c3cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:05.615264 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-192c19ec-050b-489d-a48a-c7281c46c3cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:05.616048 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-192c19ec-050b-489d-a48a-c7281c46c3cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:05.616485 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-192c19ec-050b-489d-a48a-c7281c46c3cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:05.636118 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6e852253-7b42-41e1-bb83-591b150950d6 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:05.644370 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6e852253-7b42-41e1-bb83-591b150950d6 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1736 microversion: 2.1 time: 0.154182 Jul 31 14:27:05.645126 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 306/601] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:05 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:05.747369 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-192c19ec-050b-489d-a48a-c7281c46c3cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:05.755232 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-192c19ec-050b-489d-a48a-c7281c46c3cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:05.756756 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-192c19ec-050b-489d-a48a-c7281c46c3cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:05.757923 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-192c19ec-050b-489d-a48a-c7281c46c3cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1724 microversion: 2.20 time: 0.153657 Jul 31 14:27:05.758686 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 296/602] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:27:05 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:27:06.665749 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-bfc5d0d4-4f6b-48b0-b403-e0c5023ce5c3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:06.666351 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-bfc5d0d4-4f6b-48b0-b403-e0c5023ce5c3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:06.672839 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bfc5d0d4-4f6b-48b0-b403-e0c5023ce5c3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:06.673280 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bfc5d0d4-4f6b-48b0-b403-e0c5023ce5c3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:06.674023 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bfc5d0d4-4f6b-48b0-b403-e0c5023ce5c3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:06.675077 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bfc5d0d4-4f6b-48b0-b403-e0c5023ce5c3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:06.782168 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-089344dd-9820-4250-aa60-361c5db05920 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:06.782781 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-089344dd-9820-4250-aa60-361c5db05920 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:06.789736 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-089344dd-9820-4250-aa60-361c5db05920 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:06.790182 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-089344dd-9820-4250-aa60-361c5db05920 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:06.790946 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-089344dd-9820-4250-aa60-361c5db05920 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:06.791381 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-089344dd-9820-4250-aa60-361c5db05920 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:06.803173 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bfc5d0d4-4f6b-48b0-b403-e0c5023ce5c3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:06.811061 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-bfc5d0d4-4f6b-48b0-b403-e0c5023ce5c3 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1736 microversion: 2.1 time: 0.149192 Jul 31 14:27:06.811650 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 307/603] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:06 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:06.919125 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-089344dd-9820-4250-aa60-361c5db05920 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:06.927765 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-089344dd-9820-4250-aa60-361c5db05920 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:06.929268 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-089344dd-9820-4250-aa60-361c5db05920 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:06.930415 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-089344dd-9820-4250-aa60-361c5db05920 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1724 microversion: 2.20 time: 0.152213 Jul 31 14:27:06.930985 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 297/604] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:27:06 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:27:07.832652 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9aee22fb-9c51-4f0e-985c-3d4a9c690251 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:07.833254 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9aee22fb-9c51-4f0e-985c-3d4a9c690251 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:07.839736 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9aee22fb-9c51-4f0e-985c-3d4a9c690251 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:07.840187 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9aee22fb-9c51-4f0e-985c-3d4a9c690251 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:07.840934 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9aee22fb-9c51-4f0e-985c-3d4a9c690251 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:07.841363 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9aee22fb-9c51-4f0e-985c-3d4a9c690251 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:07.953947 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-15c64fac-54e8-4755-9fbb-bbbc0b954283 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:07.955100 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-15c64fac-54e8-4755-9fbb-bbbc0b954283 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:07.961138 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-15c64fac-54e8-4755-9fbb-bbbc0b954283 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:07.961583 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-15c64fac-54e8-4755-9fbb-bbbc0b954283 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:07.962378 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-15c64fac-54e8-4755-9fbb-bbbc0b954283 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:07.962805 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-15c64fac-54e8-4755-9fbb-bbbc0b954283 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:07.973046 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9aee22fb-9c51-4f0e-985c-3d4a9c690251 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:07.981264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9aee22fb-9c51-4f0e-985c-3d4a9c690251 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1736 microversion: 2.1 time: 0.152533 Jul 31 14:27:07.982252 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 308/605] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:07 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:08.196107 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-15c64fac-54e8-4755-9fbb-bbbc0b954283 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:08.204545 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-15c64fac-54e8-4755-9fbb-bbbc0b954283 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:08.206177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-15c64fac-54e8-4755-9fbb-bbbc0b954283 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:08.207334 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-15c64fac-54e8-4755-9fbb-bbbc0b954283 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1724 microversion: 2.20 time: 0.257586 Jul 31 14:27:08.207919 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 298/606] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:27:07 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:27:08.775798 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-f0cca96c-4ada-46dd-9dff-2d17b96000f6 req-00e4f770-e762-4fca-a729-f7a38bfae7f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0810b36-49ee-482b-9e65-f587148b2a81", "name": "network-vif-deleted", "tag": "24bdbc3b-fa2f-407d-8ddb-f37abeee2dba"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:27:08.785559 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-f0cca96c-4ada-46dd-9dff-2d17b96000f6 req-00e4f770-e762-4fca-a729-f7a38bfae7f1 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:08.786007 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-f0cca96c-4ada-46dd-9dff-2d17b96000f6 req-00e4f770-e762-4fca-a729-f7a38bfae7f1 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:08.796723 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-f0cca96c-4ada-46dd-9dff-2d17b96000f6 req-00e4f770-e762-4fca-a729-f7a38bfae7f1 service nova] Creating event network-vif-deleted:24bdbc3b-fa2f-407d-8ddb-f37abeee2dba for instance d0810b36-49ee-482b-9e65-f587148b2a81 on hv-cinder-84984 Jul 31 14:27:08.801695 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-f0cca96c-4ada-46dd-9dff-2d17b96000f6 req-00e4f770-e762-4fca-a729-f7a38bfae7f1 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029588 Jul 31 14:27:08.802279 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 309/607] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:27:09.003728 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-42c42c19-9c45-464d-a6a8-96d06824ac0a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:09.004367 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-42c42c19-9c45-464d-a6a8-96d06824ac0a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:09.010745 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-42c42c19-9c45-464d-a6a8-96d06824ac0a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:09.011195 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-42c42c19-9c45-464d-a6a8-96d06824ac0a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:09.011995 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-42c42c19-9c45-464d-a6a8-96d06824ac0a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:09.012449 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-42c42c19-9c45-464d-a6a8-96d06824ac0a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:09.141819 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-42c42c19-9c45-464d-a6a8-96d06824ac0a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:09.151988 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-42c42c19-9c45-464d-a6a8-96d06824ac0a tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1736 microversion: 2.1 time: 0.152413 Jul 31 14:27:09.152774 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 299/608] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:08 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:09.232364 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-574cc5cd-c827-43d9-89ad-3bafc634c304 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:09.233070 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-574cc5cd-c827-43d9-89ad-3bafc634c304 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:09.240134 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-574cc5cd-c827-43d9-89ad-3bafc634c304 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:09.240665 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-574cc5cd-c827-43d9-89ad-3bafc634c304 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:09.241631 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-574cc5cd-c827-43d9-89ad-3bafc634c304 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:09.242008 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-574cc5cd-c827-43d9-89ad-3bafc634c304 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:09.305796 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-574cc5cd-c827-43d9-89ad-3bafc634c304 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:09.313642 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-574cc5cd-c827-43d9-89ad-3bafc634c304 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:09.315784 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-574cc5cd-c827-43d9-89ad-3bafc634c304 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:09.316938 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-574cc5cd-c827-43d9-89ad-3bafc634c304 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 200 len: 1656 microversion: 2.20 time: 0.089484 Jul 31 14:27:09.317491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 310/609] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:27:09 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 1656 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:27:10.174653 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-bf193d59-38d0-4e03-85cb-f4981a0548a2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:10.175263 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-bf193d59-38d0-4e03-85cb-f4981a0548a2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:10.181706 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bf193d59-38d0-4e03-85cb-f4981a0548a2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:10.182156 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bf193d59-38d0-4e03-85cb-f4981a0548a2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:10.182918 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bf193d59-38d0-4e03-85cb-f4981a0548a2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:10.183353 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bf193d59-38d0-4e03-85cb-f4981a0548a2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:10.309887 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-bf193d59-38d0-4e03-85cb-f4981a0548a2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:10.317907 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-bf193d59-38d0-4e03-85cb-f4981a0548a2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1716 microversion: 2.1 time: 0.147630 Jul 31 14:27:10.318479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 300/610] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:10 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1716 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:10.341091 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ddd36f57-9833-4e38-b238-6f5bca232582 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:10.342217 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ddd36f57-9833-4e38-b238-6f5bca232582 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:10.348941 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ddd36f57-9833-4e38-b238-6f5bca232582 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:10.349386 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ddd36f57-9833-4e38-b238-6f5bca232582 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:10.350150 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ddd36f57-9833-4e38-b238-6f5bca232582 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:10.350585 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ddd36f57-9833-4e38-b238-6f5bca232582 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:10.364243 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-ddd36f57-9833-4e38-b238-6f5bca232582 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] HTTP exception thrown: Instance d0810b36-49ee-482b-9e65-f587148b2a81 could not be found. Jul 31 14:27:10.365874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ddd36f57-9833-4e38-b238-6f5bca232582 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Request method failure captured: Jul 31 14:27:10.365874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 HTTP/1.1 Jul 31 14:27:10.365874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:27:10.365874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:27:10.365874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:27:10.365874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:27:10.365874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:27:10.365874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:27:10.365874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:27:10.365874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:27:10.365874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pBBs2shScHoVtG00dWWTh4-8002n0L0mrPn1eGdaBMS3DhpBfsEI9mDgxa2AQImCzjjFCcdbxLTKChvhAaGdGz-LBQ2Ug9xuiFaDHM-Is8fWpkTMwPzMnujnc1YvJ7kfFW1o7r3Zmcil2Je8fqL9ldp7fVMB7icAZWBLQAFDG5mIbU Jul 31 14:27:10.365874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:27:10.365874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:27:10.365874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:27:10.365874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:27:10.365874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 14:27:10.365874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:27:10.365874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:27:10.365874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: ae629f9940d446f2ab39e9a49b3f4753 Jul 31 14:27:10.365874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2143433277 Jul 31 14:27:10.365874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:27:10.365874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:27:10.367577 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ae629f9940d446f2ab39e9a49b3f4753"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ae629f9940d446f2ab39e9a49b3f4753", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ae629f9940d446f2ab39e9a49b3f4753"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ae629f9940d446f2ab39e9a49b3f4753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:27:10.367577 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2143433277 Jul 31 14:27:10.367577 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: ae629f9940d446f2ab39e9a49b3f4753 Jul 31 14:27:10.367577 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2143433277 Jul 31 14:27:10.367577 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeShelveTestJSON-2143433277-project Jul 31 14:27:10.367577 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:27:10.367577 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:27:10.367577 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: 53dab2ec3f2e4973893fb838c3d1d545 Jul 31 14:27:10.367577 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2143433277-project Jul 31 14:27:10.367577 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:27:10.367577 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance d0810b36-49ee-482b-9e65-f587148b2a81 could not be found. Jul 31 14:27:10.367577 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': 'd0810b36-49ee-482b-9e65-f587148b2a81'} Jul 31 14:27:10.368493 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:27:10.368493 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:27:10.368493 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:27:10.368493 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:27:10.368493 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:27:10.368493 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:27:10.368493 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:27:10.368493 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:27:10.368493 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:27:10.368493 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:27:10.368493 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0810b36-49ee-482b-9e65-f587148b2a81 could not be found. Jul 31 14:27:10.368493 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:27:10.368493 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:27:10.368493 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:27:10.368493 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:27:10.368493 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:27:10.368493 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:27:10.368493 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:27:10.368493 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:27:10.368493 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:27:10.369997 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:27:10.369997 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:27:10.369997 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:27:10.369997 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:27:10.369997 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:27:10.369997 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:27:10.369997 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:27:10.369997 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0810b36-49ee-482b-9e65-f587148b2a81 could not be found. Jul 31 14:27:10.369997 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:27:10.369997 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:27:10.369997 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:27:10.369997 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:27:10.369997 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:27:10.369997 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:27:10.369997 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:27:10.369997 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:27:10.369997 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0810b36-49ee-482b-9e65-f587148b2a81 could not be found. Jul 31 14:27:10.369997 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:27:10.371231 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ddd36f57-9833-4e38-b238-6f5bca232582 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Returning 404 to user: Instance d0810b36-49ee-482b-9e65-f587148b2a81 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:27:10.371231 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ddd36f57-9833-4e38-b238-6f5bca232582 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 404 len: 111 microversion: 2.20 time: 0.030218 Jul 31 14:27:10.371231 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 311/611] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:27:10 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 14:27:10.376610 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-6a7bbcaa-346a-4e84-8bcb-8d24b7b91953 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '.version_select at 0x7f87e99f3820>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:10.396202 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-6a7bbcaa-346a-4e84-8bcb-8d24b7b91953 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1588211006" status: 204 len: 0 microversion: 2.20 time: 0.023407 Jul 31 14:27:10.396769 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 301/612] 10.222.0.40 () {60 vars in 1262 bytes} [Sun Jul 31 14:27:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1588211006 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 14:27:10.430664 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4eff40cc-0d0e-4895-bd2d-9ff6bca41074 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:10.431351 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4eff40cc-0d0e-4895-bd2d-9ff6bca41074 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:10.437812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4eff40cc-0d0e-4895-bd2d-9ff6bca41074 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:10.438288 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4eff40cc-0d0e-4895-bd2d-9ff6bca41074 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:10.439117 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4eff40cc-0d0e-4895-bd2d-9ff6bca41074 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:10.439554 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4eff40cc-0d0e-4895-bd2d-9ff6bca41074 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:10.527628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-4eff40cc-0d0e-4895-bd2d-9ff6bca41074 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] HTTP exception thrown: Cannot 'detach_volume' instance 337cbeb6-512e-4bf5-bd53-cd837c00947e while it is in vm_state rescued Jul 31 14:27:10.529141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4eff40cc-0d0e-4895-bd2d-9ff6bca41074 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Request method failure captured: Jul 31 14:27:10.529141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: DELETE /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e/os-volume_attachments/9674eddb-1c82-4c41-99cf-406a9ae8f33e HTTP/1.1 Jul 31 14:27:10.529141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:27:10.529141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:27:10.529141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:27:10.529141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:27:10.529141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:27:10.529141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:27:10.529141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:27:10.529141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:27:10.529141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pBD72W1Rjv6at1WfVNUymNduY_N-nFbxGXJkrDc28rQU3JtMQkgCsFoz5JacBevK8YSVtt5PGEmj8VgqIeKUZCOYsB9PlAVGw4jymIy85OyVcpnTAbNXZcwZxntPYKfyuD8D6hHzBOe0TS_x7j6S_M-nQlq-6OQzOt_ElSF-AtfcFg Jul 31 14:27:10.529141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:27:10.529141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:27:10.529141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:27:10.529141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:27:10.529141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:27:10.529141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:27:10.529141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: 832629dd8594494ab41b6596b2d73076 Jul 31 14:27:10.529141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1831825154 Jul 31 14:27:10.529141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:27:10.529141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:27:10.530635 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/832629dd8594494ab41b6596b2d73076"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_832629dd8594494ab41b6596b2d73076", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/832629dd8594494ab41b6596b2d73076"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/832629dd8594494ab41b6596b2d73076"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:27:10.530635 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1831825154 Jul 31 14:27:10.530635 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 832629dd8594494ab41b6596b2d73076 Jul 31 14:27:10.530635 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1831825154 Jul 31 14:27:10.530635 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-ServerRescueNegativeTestJSON-1831825154-project Jul 31 14:27:10.530635 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:27:10.530635 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:27:10.530635 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: 10a4469c46f64feb819f3b19a0f4e89b Jul 31 14:27:10.530635 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1831825154-project Jul 31 14:27:10.530635 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:27:10.530635 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Cannot 'detach_volume' instance 337cbeb6-512e-4bf5-bd53-cd837c00947e while it is in vm_state rescued Jul 31 14:27:10.531376 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'server_id': '337cbeb6-512e-4bf5-bd53-cd837c00947e', 'id': '9674eddb-1c82-4c41-99cf-406a9ae8f33e'} Jul 31 14:27:10.531376 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:27:10.531376 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:27:10.531376 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 31 14:27:10.531376 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 31 14:27:10.531376 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 14:27:10.531376 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 14:27:10.531376 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 31 14:27:10.531376 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 31 14:27:10.531376 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 337cbeb6-512e-4bf5-bd53-cd837c00947e in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 31 14:27:10.531376 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:27:10.531376 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:27:10.531376 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:27:10.531376 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:27:10.531376 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:27:10.531376 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:27:10.531376 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:27:10.531376 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:27:10.531376 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:27:10.531376 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:27:10.532871 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 31 14:27:10.532871 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 31 14:27:10.532871 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 31 14:27:10.532871 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 31 14:27:10.532871 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 337cbeb6-512e-4bf5-bd53-cd837c00947e while it is in vm_state rescued Jul 31 14:27:10.532871 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:27:10.532871 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:27:10.532871 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:27:10.532871 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:27:10.532871 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:27:10.532871 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:27:10.532871 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:27:10.532871 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:27:10.532871 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 337cbeb6-512e-4bf5-bd53-cd837c00947e while it is in vm_state rescued Jul 31 14:27:10.532871 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:27:10.532871 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4eff40cc-0d0e-4895-bd2d-9ff6bca41074 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Returning 409 to user: Cannot 'detach_volume' instance 337cbeb6-512e-4bf5-bd53-cd837c00947e while it is in vm_state rescued {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:27:10.534522 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4eff40cc-0d0e-4895-bd2d-9ff6bca41074 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "DELETE /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e/os-volume_attachments/9674eddb-1c82-4c41-99cf-406a9ae8f33e" status: 409 len: 152 microversion: 2.1 time: 0.103906 Jul 31 14:27:10.534522 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 312/613] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Jul 31 14:27:10 2022] DELETE /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e/os-volume_attachments/9674eddb-1c82-4c41-99cf-406a9ae8f33e => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 31 14:27:10.540363 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-2b9a7cc5-4749-4caa-83db-dcc75f2942d7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:27:10.540891 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-2b9a7cc5-4749-4caa-83db-dcc75f2942d7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:10.547483 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2b9a7cc5-4749-4caa-83db-dcc75f2942d7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:10.548282 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2b9a7cc5-4749-4caa-83db-dcc75f2942d7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:10.549825 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2b9a7cc5-4749-4caa-83db-dcc75f2942d7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:10.550331 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2b9a7cc5-4749-4caa-83db-dcc75f2942d7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:10.625017 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-2b9a7cc5-4749-4caa-83db-dcc75f2942d7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "POST /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e/action" status: 202 len: 0 microversion: 2.1 time: 0.088749 Jul 31 14:27:10.625655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 302/614] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Jul 31 14:27:10 2022] POST /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:27:10.635691 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4b3427b8-2064-4b85-abf3-1853345e6c76 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:10.636223 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4b3427b8-2064-4b85-abf3-1853345e6c76 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:10.642959 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4b3427b8-2064-4b85-abf3-1853345e6c76 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:10.643535 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4b3427b8-2064-4b85-abf3-1853345e6c76 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:10.644393 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4b3427b8-2064-4b85-abf3-1853345e6c76 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:10.645003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4b3427b8-2064-4b85-abf3-1853345e6c76 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:10.860058 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4b3427b8-2064-4b85-abf3-1853345e6c76 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:10.868058 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4b3427b8-2064-4b85-abf3-1853345e6c76 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1724 microversion: 2.1 time: 0.238074 Jul 31 14:27:10.869184 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 313/615] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:10 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:11.160857 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-cb409b3c-d3ba-49c8-947b-0f543bea97e9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Action: 'create', calling method: .version_select at 0x7f87e99f38b0>, body: {"keypair": {"name": "tempest-keypair-1310930531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUzcKYgqIcCAfweZD2euX+dxn60/stJIelGJY+B9gYW38H7dv04lIo37D+WUnZZMEbXpsUibYl0VRRJLjxiEWGVxzvcL+uIDqTTihsl5l1zqY1xeQ4p6ReOIPXPPmnKqw=="}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:27:11.179072 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-cb409b3c-d3ba-49c8-947b-0f543bea97e9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Getting quotas for project ae629f9940d446f2ab39e9a49b3f4753. Resources: {'key_pairs'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:27:11.182878 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-cb409b3c-d3ba-49c8-947b-0f543bea97e9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Getting quotas for user 53dab2ec3f2e4973893fb838c3d1d545 and project ae629f9940d446f2ab39e9a49b3f4753. Resources: {'key_pairs'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:27:11.185293 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:27:11.210333 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-cb409b3c-d3ba-49c8-947b-0f543bea97e9 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.055812 Jul 31 14:27:11.210943 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 303/616] 10.222.0.40 () {62 vars in 1200 bytes} [Sun Jul 31 14:27:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 31 14:27:11.891058 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-40d3aafb-a2d8-4dcf-bcd7-60e3ee1dc6b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:11.891725 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-40d3aafb-a2d8-4dcf-bcd7-60e3ee1dc6b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:11.900047 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-40d3aafb-a2d8-4dcf-bcd7-60e3ee1dc6b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:11.900687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-40d3aafb-a2d8-4dcf-bcd7-60e3ee1dc6b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:11.901530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-40d3aafb-a2d8-4dcf-bcd7-60e3ee1dc6b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:11.902054 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-40d3aafb-a2d8-4dcf-bcd7-60e3ee1dc6b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:12.132885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-40d3aafb-a2d8-4dcf-bcd7-60e3ee1dc6b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:12.141287 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-40d3aafb-a2d8-4dcf-bcd7-60e3ee1dc6b2 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1724 microversion: 2.1 time: 0.255262 Jul 31 14:27:12.141929 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 314/617] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:11 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:12.798692 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-bceeb796-b788-4568-a694-31fd783f32dc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1448117014", "imageRef": "57bc051a-64d0-4317-aa93-a7a2aed39369", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b6a43aa-cc11-41ae-aa14-00f6b134f366"}], "security_groups": [{"name": "tempest-securitygroup--1337896616"}], "key_name": "tempest-keypair-1310930531", "user_data": "}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:27:12.907387 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.network.neutron [None req-bceeb796-b788-4568-a694-31fd783f32dc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] validate_networks() for [('6b6a43aa-cc11-41ae-aa14-00f6b134f366', None, None, None, None, None)] {{(pid=117781) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 14:27:13.162274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-261dd7bd-3c25-4812-9725-a562c9ecfc3f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:13.163144 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-261dd7bd-3c25-4812-9725-a562c9ecfc3f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:13.170520 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-261dd7bd-3c25-4812-9725-a562c9ecfc3f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:13.171176 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-261dd7bd-3c25-4812-9725-a562c9ecfc3f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:13.172087 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-261dd7bd-3c25-4812-9725-a562c9ecfc3f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:13.172491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-261dd7bd-3c25-4812-9725-a562c9ecfc3f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:13.313773 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-261dd7bd-3c25-4812-9725-a562c9ecfc3f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:13.321870 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-261dd7bd-3c25-4812-9725-a562c9ecfc3f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1724 microversion: 2.1 time: 0.163536 Jul 31 14:27:13.322514 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 315/618] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:13 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:13.541256 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-bceeb796-b788-4568-a694-31fd783f32dc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Flavor limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 14:27:13.541681 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-bceeb796-b788-4568-a694-31fd783f32dc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Image limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 14:27:13.542156 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-bceeb796-b788-4568-a694-31fd783f32dc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Flavor pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 14:27:13.542568 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-bceeb796-b788-4568-a694-31fd783f32dc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Image pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 14:27:13.542981 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-bceeb796-b788-4568-a694-31fd783f32dc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 14:27:13.553274 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bceeb796-b788-4568-a694-31fd783f32dc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:13.553830 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bceeb796-b788-4568-a694-31fd783f32dc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:13.554640 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bceeb796-b788-4568-a694-31fd783f32dc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:13.555105 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bceeb796-b788-4568-a694-31fd783f32dc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:13.571293 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-bceeb796-b788-4568-a694-31fd783f32dc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Getting quotas for project ae629f9940d446f2ab39e9a49b3f4753. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:27:13.575480 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-bceeb796-b788-4568-a694-31fd783f32dc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Getting quotas for user 53dab2ec3f2e4973893fb838c3d1d545 and project ae629f9940d446f2ab39e9a49b3f4753. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:27:13.586380 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-bceeb796-b788-4568-a694-31fd783f32dc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Going to run 1 instances... {{(pid=117781) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 14:27:13.588726 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-bceeb796-b788-4568-a694-31fd783f32dc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57bc051a-64d0-4317-aa93-a7a2aed39369',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117781) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 14:27:13.634084 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-bceeb796-b788-4568-a694-31fd783f32dc tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.839844 Jul 31 14:27:13.634728 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 304/619] 10.222.0.40 () {62 vars in 1188 bytes} [Sun Jul 31 14:27:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 31 14:27:13.645584 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2b8b8795-5113-409a-9aad-b330505740a4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:13.646264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2b8b8795-5113-409a-9aad-b330505740a4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:13.702012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2b8b8795-5113-409a-9aad-b330505740a4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:13.709976 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2b8b8795-5113-409a-9aad-b330505740a4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:13.711510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2b8b8795-5113-409a-9aad-b330505740a4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:13.712635 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2b8b8795-5113-409a-9aad-b330505740a4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1282 microversion: 2.20 time: 0.070884 Jul 31 14:27:13.713212 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 316/620] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:27:13 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:27:14.343312 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-337f7b34-4017-4ca2-a97a-46f511290730 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:14.343904 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-337f7b34-4017-4ca2-a97a-46f511290730 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:14.351313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-337f7b34-4017-4ca2-a97a-46f511290730 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:14.351795 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-337f7b34-4017-4ca2-a97a-46f511290730 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:14.352557 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-337f7b34-4017-4ca2-a97a-46f511290730 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:14.352992 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-337f7b34-4017-4ca2-a97a-46f511290730 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:14.479580 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-337f7b34-4017-4ca2-a97a-46f511290730 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:14.488056 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-337f7b34-4017-4ca2-a97a-46f511290730 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1730 microversion: 2.1 time: 0.148778 Jul 31 14:27:14.488630 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 305/621] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:14 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:14.508770 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-96aaae37-5591-4963-95c6-5ef4dadd7435 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:14.509320 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-96aaae37-5591-4963-95c6-5ef4dadd7435 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:14.515696 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-96aaae37-5591-4963-95c6-5ef4dadd7435 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:14.516148 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-96aaae37-5591-4963-95c6-5ef4dadd7435 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:14.516913 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-96aaae37-5591-4963-95c6-5ef4dadd7435 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:14.517351 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-96aaae37-5591-4963-95c6-5ef4dadd7435 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:14.597048 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-96aaae37-5591-4963-95c6-5ef4dadd7435 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092091 Jul 31 14:27:14.597659 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 317/622] 10.222.0.40 () {58 vars in 1275 bytes} [Sun Jul 31 14:27:14 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:27:14.737776 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-20d247c8-0710-44fb-8898-2b03b7a9f97f tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:14.738710 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-20d247c8-0710-44fb-8898-2b03b7a9f97f tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:14.744990 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-20d247c8-0710-44fb-8898-2b03b7a9f97f tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:14.746546 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-20d247c8-0710-44fb-8898-2b03b7a9f97f tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:14.747342 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-20d247c8-0710-44fb-8898-2b03b7a9f97f tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:14.747814 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-20d247c8-0710-44fb-8898-2b03b7a9f97f tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:14.847222 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-20d247c8-0710-44fb-8898-2b03b7a9f97f tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:14.857016 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-20d247c8-0710-44fb-8898-2b03b7a9f97f tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:14.860864 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-20d247c8-0710-44fb-8898-2b03b7a9f97f tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:14.862294 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-20d247c8-0710-44fb-8898-2b03b7a9f97f tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1342 microversion: 2.20 time: 0.128297 Jul 31 14:27:14.862879 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 306/623] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:27:14 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1342 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:27:15.534876 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-3745ddbc-1a9e-44a5-98f6-8a75f6940f1f req-cb93dd22-dddd-4a1b-99fe-02d7b865a845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337cbeb6-512e-4bf5-bd53-cd837c00947e", "tag": "8cbcf7d3-6045-42ae-b5a4-ef6ca863d210"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:27:15.549915 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-3745ddbc-1a9e-44a5-98f6-8a75f6940f1f req-cb93dd22-dddd-4a1b-99fe-02d7b865a845 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:15.550490 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-3745ddbc-1a9e-44a5-98f6-8a75f6940f1f req-cb93dd22-dddd-4a1b-99fe-02d7b865a845 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:15.567559 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-3745ddbc-1a9e-44a5-98f6-8a75f6940f1f req-cb93dd22-dddd-4a1b-99fe-02d7b865a845 service nova] Creating event network-changed:8cbcf7d3-6045-42ae-b5a4-ef6ca863d210 for instance 337cbeb6-512e-4bf5-bd53-cd837c00947e on hv-cinder-84984 Jul 31 14:27:15.588664 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-3745ddbc-1a9e-44a5-98f6-8a75f6940f1f req-cb93dd22-dddd-4a1b-99fe-02d7b865a845 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063079 Jul 31 14:27:15.593924 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 318/624] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:27:15.885375 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-e1c0c52b-ba64-4df3-b1a3-c041a1187480 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:15.886129 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-e1c0c52b-ba64-4df3-b1a3-c041a1187480 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:15.896409 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e1c0c52b-ba64-4df3-b1a3-c041a1187480 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:15.897004 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e1c0c52b-ba64-4df3-b1a3-c041a1187480 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:15.898086 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e1c0c52b-ba64-4df3-b1a3-c041a1187480 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:15.898747 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e1c0c52b-ba64-4df3-b1a3-c041a1187480 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:16.226852 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e1c0c52b-ba64-4df3-b1a3-c041a1187480 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:16.236263 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e1c0c52b-ba64-4df3-b1a3-c041a1187480 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:16.238413 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e1c0c52b-ba64-4df3-b1a3-c041a1187480 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:16.240141 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-e1c0c52b-ba64-4df3-b1a3-c041a1187480 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1408 microversion: 2.20 time: 0.358686 Jul 31 14:27:16.253781 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 307/625] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:27:15 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1408 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:27:16.703215 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-2f62d9fa-2ae0-4d52-8fae-0fb09fe04522 req-a468d1d6-ce7e-43b2-8bdd-085e1ed3aa44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6200d587-a817-4a77-b242-ec578e8e57dc", "tag": "414cf0f9-b0cd-4363-9160-1242693140a5"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:27:16.716760 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-2f62d9fa-2ae0-4d52-8fae-0fb09fe04522 req-a468d1d6-ce7e-43b2-8bdd-085e1ed3aa44 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:16.717207 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-2f62d9fa-2ae0-4d52-8fae-0fb09fe04522 req-a468d1d6-ce7e-43b2-8bdd-085e1ed3aa44 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:16.728407 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-2f62d9fa-2ae0-4d52-8fae-0fb09fe04522 req-a468d1d6-ce7e-43b2-8bdd-085e1ed3aa44 service nova] Creating event network-changed:414cf0f9-b0cd-4363-9160-1242693140a5 for instance 6200d587-a817-4a77-b242-ec578e8e57dc on hv-cinder-84984 Jul 31 14:27:16.733898 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-2f62d9fa-2ae0-4d52-8fae-0fb09fe04522 req-a468d1d6-ce7e-43b2-8bdd-085e1ed3aa44 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035797 Jul 31 14:27:16.734700 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 319/626] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:27:17.263947 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-095c02b6-fccf-4656-8699-acaedb27f640 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:17.264629 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-095c02b6-fccf-4656-8699-acaedb27f640 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:17.271907 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-095c02b6-fccf-4656-8699-acaedb27f640 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:17.272357 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-095c02b6-fccf-4656-8699-acaedb27f640 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:17.273122 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-095c02b6-fccf-4656-8699-acaedb27f640 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:17.273560 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-095c02b6-fccf-4656-8699-acaedb27f640 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:17.406802 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-095c02b6-fccf-4656-8699-acaedb27f640 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:17.414809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-095c02b6-fccf-4656-8699-acaedb27f640 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:17.416357 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-095c02b6-fccf-4656-8699-acaedb27f640 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:17.417455 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-095c02b6-fccf-4656-8699-acaedb27f640 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1408 microversion: 2.20 time: 0.157424 Jul 31 14:27:17.418015 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 308/627] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:27:17 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:27:17.605124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-3691fa24-86a6-44fa-8f85-e43a11ccc5be req-f6a7979b-e489-484b-b69d-1d700bf06a04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337cbeb6-512e-4bf5-bd53-cd837c00947e", "tag": "8cbcf7d3-6045-42ae-b5a4-ef6ca863d210"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:27:17.614945 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-3691fa24-86a6-44fa-8f85-e43a11ccc5be req-f6a7979b-e489-484b-b69d-1d700bf06a04 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:17.615374 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-3691fa24-86a6-44fa-8f85-e43a11ccc5be req-f6a7979b-e489-484b-b69d-1d700bf06a04 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:17.625637 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-3691fa24-86a6-44fa-8f85-e43a11ccc5be req-f6a7979b-e489-484b-b69d-1d700bf06a04 service nova] Creating event network-changed:8cbcf7d3-6045-42ae-b5a4-ef6ca863d210 for instance 337cbeb6-512e-4bf5-bd53-cd837c00947e on hv-cinder-84984 Jul 31 14:27:17.630935 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-3691fa24-86a6-44fa-8f85-e43a11ccc5be req-f6a7979b-e489-484b-b69d-1d700bf06a04 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029787 Jul 31 14:27:17.631518 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 320/628] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:27:18.440497 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-887527d4-b0b7-4c90-8aad-b4be8e0b4b48 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:18.441106 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-887527d4-b0b7-4c90-8aad-b4be8e0b4b48 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:18.447691 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-887527d4-b0b7-4c90-8aad-b4be8e0b4b48 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:18.448233 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-887527d4-b0b7-4c90-8aad-b4be8e0b4b48 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:18.449071 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-887527d4-b0b7-4c90-8aad-b4be8e0b4b48 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:18.449602 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-887527d4-b0b7-4c90-8aad-b4be8e0b4b48 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:18.760453 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-887527d4-b0b7-4c90-8aad-b4be8e0b4b48 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:18.769503 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-887527d4-b0b7-4c90-8aad-b4be8e0b4b48 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:18.771064 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-887527d4-b0b7-4c90-8aad-b4be8e0b4b48 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:18.772215 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-887527d4-b0b7-4c90-8aad-b4be8e0b4b48 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1408 microversion: 2.20 time: 0.335706 Jul 31 14:27:18.773059 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 309/629] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:27:18 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1408 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:27:19.795103 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d973566b-d15b-413c-b9d8-e587f06d3662 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:19.795846 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d973566b-d15b-413c-b9d8-e587f06d3662 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:19.801940 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d973566b-d15b-413c-b9d8-e587f06d3662 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:19.802381 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d973566b-d15b-413c-b9d8-e587f06d3662 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:19.803130 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d973566b-d15b-413c-b9d8-e587f06d3662 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:19.803594 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d973566b-d15b-413c-b9d8-e587f06d3662 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:19.932104 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d973566b-d15b-413c-b9d8-e587f06d3662 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:19.940079 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d973566b-d15b-413c-b9d8-e587f06d3662 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:19.941635 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d973566b-d15b-413c-b9d8-e587f06d3662 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:19.942732 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d973566b-d15b-413c-b9d8-e587f06d3662 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1408 microversion: 2.20 time: 0.152328 Jul 31 14:27:19.943299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 321/630] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:27:19 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:27:20.966027 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b88d083a-ed62-40d6-9df6-e9708de42215 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:20.966672 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b88d083a-ed62-40d6-9df6-e9708de42215 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:20.973791 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b88d083a-ed62-40d6-9df6-e9708de42215 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:20.974248 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b88d083a-ed62-40d6-9df6-e9708de42215 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:20.975031 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b88d083a-ed62-40d6-9df6-e9708de42215 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:20.975731 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b88d083a-ed62-40d6-9df6-e9708de42215 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:21.106645 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b88d083a-ed62-40d6-9df6-e9708de42215 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:21.115138 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b88d083a-ed62-40d6-9df6-e9708de42215 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:21.116684 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b88d083a-ed62-40d6-9df6-e9708de42215 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:21.117829 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b88d083a-ed62-40d6-9df6-e9708de42215 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1408 microversion: 2.20 time: 0.155666 Jul 31 14:27:21.118401 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 310/631] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:27:20 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:27:22.140333 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-bf351e6c-5e2c-4eef-8054-35892c922ef4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:22.140941 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-bf351e6c-5e2c-4eef-8054-35892c922ef4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:22.147530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bf351e6c-5e2c-4eef-8054-35892c922ef4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:22.147986 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bf351e6c-5e2c-4eef-8054-35892c922ef4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:22.148743 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bf351e6c-5e2c-4eef-8054-35892c922ef4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:22.149179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bf351e6c-5e2c-4eef-8054-35892c922ef4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:22.280252 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bf351e6c-5e2c-4eef-8054-35892c922ef4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:22.288593 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bf351e6c-5e2c-4eef-8054-35892c922ef4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:22.290136 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bf351e6c-5e2c-4eef-8054-35892c922ef4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:22.291232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-bf351e6c-5e2c-4eef-8054-35892c922ef4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1408 microversion: 2.20 time: 0.154883 Jul 31 14:27:22.291822 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 322/632] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:27:22 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:27:23.313847 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-459ccc46-e4b9-4ba4-bc0c-f6fcf4c9b6be tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:23.314388 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-459ccc46-e4b9-4ba4-bc0c-f6fcf4c9b6be tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:23.320926 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-459ccc46-e4b9-4ba4-bc0c-f6fcf4c9b6be tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:23.321405 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-459ccc46-e4b9-4ba4-bc0c-f6fcf4c9b6be tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:23.322162 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-459ccc46-e4b9-4ba4-bc0c-f6fcf4c9b6be tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:23.322599 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-459ccc46-e4b9-4ba4-bc0c-f6fcf4c9b6be tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:23.454565 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-459ccc46-e4b9-4ba4-bc0c-f6fcf4c9b6be tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:23.463058 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-459ccc46-e4b9-4ba4-bc0c-f6fcf4c9b6be tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:23.464606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-459ccc46-e4b9-4ba4-bc0c-f6fcf4c9b6be tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:23.465708 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-459ccc46-e4b9-4ba4-bc0c-f6fcf4c9b6be tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1408 microversion: 2.20 time: 0.155775 Jul 31 14:27:23.466272 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 311/633] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:27:23 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:27:23.836969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-22c143b9-d561-48f1-9b8f-e19c76451aec req-336752b5-77da-4db7-8818-198d14015a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6200d587-a817-4a77-b242-ec578e8e57dc", "name": "network-vif-plugged", "status": "completed", "tag": "414cf0f9-b0cd-4363-9160-1242693140a5"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:27:23.842343 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:27:23.848372 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-22c143b9-d561-48f1-9b8f-e19c76451aec req-336752b5-77da-4db7-8818-198d14015a74 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:23.848873 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-22c143b9-d561-48f1-9b8f-e19c76451aec req-336752b5-77da-4db7-8818-198d14015a74 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:23.861083 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-22c143b9-d561-48f1-9b8f-e19c76451aec req-336752b5-77da-4db7-8818-198d14015a74 service nova] Creating event network-vif-plugged:414cf0f9-b0cd-4363-9160-1242693140a5 for instance 6200d587-a817-4a77-b242-ec578e8e57dc on hv-cinder-84984 Jul 31 14:27:23.866316 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-22c143b9-d561-48f1-9b8f-e19c76451aec req-336752b5-77da-4db7-8818-198d14015a74 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032894 Jul 31 14:27:23.867314 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 323/634] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:27:24.489139 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-cc8767c6-f034-4603-acf1-0f1234857be3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:24.489751 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-cc8767c6-f034-4603-acf1-0f1234857be3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:24.491611 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:27:24.492421 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=10 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:27:24.498901 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-cc8767c6-f034-4603-acf1-0f1234857be3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:24.499354 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-cc8767c6-f034-4603-acf1-0f1234857be3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:24.500146 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-cc8767c6-f034-4603-acf1-0f1234857be3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:24.500590 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-cc8767c6-f034-4603-acf1-0f1234857be3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:24.632059 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-cc8767c6-f034-4603-acf1-0f1234857be3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:24.640951 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-cc8767c6-f034-4603-acf1-0f1234857be3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:24.642610 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-cc8767c6-f034-4603-acf1-0f1234857be3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:24.643750 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-cc8767c6-f034-4603-acf1-0f1234857be3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1408 microversion: 2.20 time: 0.159031 Jul 31 14:27:24.644320 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 312/635] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:27:24 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:27:25.666610 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9304488c-349d-4b92-977b-2ec7ed3db574 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:25.667346 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9304488c-349d-4b92-977b-2ec7ed3db574 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:25.674059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9304488c-349d-4b92-977b-2ec7ed3db574 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:25.674511 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9304488c-349d-4b92-977b-2ec7ed3db574 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:25.675785 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9304488c-349d-4b92-977b-2ec7ed3db574 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:25.676224 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9304488c-349d-4b92-977b-2ec7ed3db574 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:25.804714 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9304488c-349d-4b92-977b-2ec7ed3db574 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:25.812523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9304488c-349d-4b92-977b-2ec7ed3db574 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:25.814022 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9304488c-349d-4b92-977b-2ec7ed3db574 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:25.815115 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9304488c-349d-4b92-977b-2ec7ed3db574 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1408 microversion: 2.20 time: 0.152757 Jul 31 14:27:25.816326 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 324/636] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:27:25 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:27:26.838560 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-eadc20c6-490d-4f90-955c-f46e1f70680a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:26.839173 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-eadc20c6-490d-4f90-955c-f46e1f70680a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:26.845660 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eadc20c6-490d-4f90-955c-f46e1f70680a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:26.846114 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eadc20c6-490d-4f90-955c-f46e1f70680a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:26.846937 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eadc20c6-490d-4f90-955c-f46e1f70680a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:26.847375 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eadc20c6-490d-4f90-955c-f46e1f70680a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:26.851628 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:27:26.998744 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-eadc20c6-490d-4f90-955c-f46e1f70680a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:27.007195 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-eadc20c6-490d-4f90-955c-f46e1f70680a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:27.008750 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-eadc20c6-490d-4f90-955c-f46e1f70680a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:27.009924 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-eadc20c6-490d-4f90-955c-f46e1f70680a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1600 microversion: 2.20 time: 0.175302 Jul 31 14:27:27.010462 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 313/637] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:27:26 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1600 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:27:27.032649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b59c2710-1e0e-4112-a7ad-c984b2a132c1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:27.033207 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b59c2710-1e0e-4112-a7ad-c984b2a132c1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:27.039752 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b59c2710-1e0e-4112-a7ad-c984b2a132c1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:27.040410 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b59c2710-1e0e-4112-a7ad-c984b2a132c1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:27.041169 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b59c2710-1e0e-4112-a7ad-c984b2a132c1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:27.041602 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b59c2710-1e0e-4112-a7ad-c984b2a132c1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:27.118343 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b59c2710-1e0e-4112-a7ad-c984b2a132c1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089475 Jul 31 14:27:27.121429 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 325/638] 10.222.0.40 () {60 vars in 1316 bytes} [Sun Jul 31 14:27:27 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 14:27:28.042329 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-368d9969-3d99-436b-9552-14762d8a1cb0 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:27:28.042866 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-368d9969-3d99-436b-9552-14762d8a1cb0 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:28.050048 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-368d9969-3d99-436b-9552-14762d8a1cb0 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:28.050421 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-368d9969-3d99-436b-9552-14762d8a1cb0 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:28.053627 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-368d9969-3d99-436b-9552-14762d8a1cb0 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:28.053627 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-368d9969-3d99-436b-9552-14762d8a1cb0 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:28.062102 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-780b84a1-95e5-4426-9ca2-4ed8c25ea550 req-5340a963-09e4-4df9-a0b2-b9d77718ec3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6200d587-a817-4a77-b242-ec578e8e57dc", "tag": "414cf0f9-b0cd-4363-9160-1242693140a5"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:27:28.074162 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-780b84a1-95e5-4426-9ca2-4ed8c25ea550 req-5340a963-09e4-4df9-a0b2-b9d77718ec3a service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:28.074904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-780b84a1-95e5-4426-9ca2-4ed8c25ea550 req-5340a963-09e4-4df9-a0b2-b9d77718ec3a service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:28.077245 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.objects.instance [None req-368d9969-3d99-436b-9552-14762d8a1cb0 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lazy-loading 'flavor' on Instance uuid 92439dcd-76b3-44fb-882b-1b8f0dcb9d73 {{(pid=117781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:27:28.088872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-780b84a1-95e5-4426-9ca2-4ed8c25ea550 req-5340a963-09e4-4df9-a0b2-b9d77718ec3a service nova] Creating event network-changed:414cf0f9-b0cd-4363-9160-1242693140a5 for instance 6200d587-a817-4a77-b242-ec578e8e57dc on hv-cinder-84984 Jul 31 14:27:28.093964 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-780b84a1-95e5-4426-9ca2-4ed8c25ea550 req-5340a963-09e4-4df9-a0b2-b9d77718ec3a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035907 Jul 31 14:27:28.094891 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 326/639] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:27:28.153683 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-368d9969-3d99-436b-9552-14762d8a1cb0 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "POST /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73/action" status: 202 len: 0 microversion: 2.1 time: 0.115070 Jul 31 14:27:28.154284 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 314/640] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Jul 31 14:27:28 2022] POST /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:27:28.164372 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7d1f5df5-93d2-43fb-a596-be7186403421 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:28.165874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7d1f5df5-93d2-43fb-a596-be7186403421 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:28.172589 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7d1f5df5-93d2-43fb-a596-be7186403421 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:28.174019 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7d1f5df5-93d2-43fb-a596-be7186403421 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:28.174466 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7d1f5df5-93d2-43fb-a596-be7186403421 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:28.175777 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7d1f5df5-93d2-43fb-a596-be7186403421 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:28.326415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7d1f5df5-93d2-43fb-a596-be7186403421 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:28.334428 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7d1f5df5-93d2-43fb-a596-be7186403421 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1566 microversion: 2.1 time: 0.175589 Jul 31 14:27:28.335139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 327/641] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:28 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:29.356758 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-d544cc66-05a4-4422-9ff7-fae2de8f782e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:29.357448 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-d544cc66-05a4-4422-9ff7-fae2de8f782e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:29.364320 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d544cc66-05a4-4422-9ff7-fae2de8f782e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:29.364771 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d544cc66-05a4-4422-9ff7-fae2de8f782e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:29.365534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d544cc66-05a4-4422-9ff7-fae2de8f782e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:29.365975 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d544cc66-05a4-4422-9ff7-fae2de8f782e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:29.499001 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-d544cc66-05a4-4422-9ff7-fae2de8f782e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:29.506509 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-d544cc66-05a4-4422-9ff7-fae2de8f782e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1566 microversion: 2.1 time: 0.154531 Jul 31 14:27:29.507078 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 315/642] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:29 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:30.528365 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d8a459ed-eef8-45ed-bff8-ca461bccaf70 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:30.528937 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d8a459ed-eef8-45ed-bff8-ca461bccaf70 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:30.536151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d8a459ed-eef8-45ed-bff8-ca461bccaf70 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:30.536603 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d8a459ed-eef8-45ed-bff8-ca461bccaf70 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:30.537372 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d8a459ed-eef8-45ed-bff8-ca461bccaf70 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:30.537810 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d8a459ed-eef8-45ed-bff8-ca461bccaf70 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:30.668051 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d8a459ed-eef8-45ed-bff8-ca461bccaf70 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:30.676152 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d8a459ed-eef8-45ed-bff8-ca461bccaf70 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1566 microversion: 2.1 time: 0.151773 Jul 31 14:27:30.676725 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 328/643] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:30 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:31.697326 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-9ebcbbc5-094b-4568-a427-a9ec805b4d28 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:31.697956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-9ebcbbc5-094b-4568-a427-a9ec805b4d28 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:31.704801 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9ebcbbc5-094b-4568-a427-a9ec805b4d28 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:31.705254 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9ebcbbc5-094b-4568-a427-a9ec805b4d28 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:31.706020 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9ebcbbc5-094b-4568-a427-a9ec805b4d28 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:31.706459 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9ebcbbc5-094b-4568-a427-a9ec805b4d28 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:31.836512 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-9ebcbbc5-094b-4568-a427-a9ec805b4d28 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:31.843966 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-9ebcbbc5-094b-4568-a427-a9ec805b4d28 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1566 microversion: 2.1 time: 0.150568 Jul 31 14:27:31.844535 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 316/644] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:31 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:32.554795 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9232b658-e456-46ed-957a-92ff1d46a16d tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:27:32.556928 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9232b658-e456-46ed-957a-92ff1d46a16d tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:32.563475 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9232b658-e456-46ed-957a-92ff1d46a16d tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:32.563927 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9232b658-e456-46ed-957a-92ff1d46a16d tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:32.564687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9232b658-e456-46ed-957a-92ff1d46a16d tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:32.565121 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9232b658-e456-46ed-957a-92ff1d46a16d tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:32.583387 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=100 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:27:32.634791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9232b658-e456-46ed-957a-92ff1d46a16d tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "POST /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7/action" status: 202 len: 0 microversion: 2.1 time: 0.083784 Jul 31 14:27:32.635466 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 329/645] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Jul 31 14:27:32 2022] POST /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:27:32.644246 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-69634a0d-3c90-48ee-a85c-331a9f9edd1c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:32.644853 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-69634a0d-3c90-48ee-a85c-331a9f9edd1c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:32.650942 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-69634a0d-3c90-48ee-a85c-331a9f9edd1c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:32.651391 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-69634a0d-3c90-48ee-a85c-331a9f9edd1c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:32.652184 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-69634a0d-3c90-48ee-a85c-331a9f9edd1c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:32.652627 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-69634a0d-3c90-48ee-a85c-331a9f9edd1c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:32.864987 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-587ff95a-16e1-465d-8588-5f72e479526c tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:32.865663 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-587ff95a-16e1-465d-8588-5f72e479526c tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:32.871992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-587ff95a-16e1-465d-8588-5f72e479526c tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:32.872448 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-587ff95a-16e1-465d-8588-5f72e479526c tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:32.873219 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-587ff95a-16e1-465d-8588-5f72e479526c tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:32.873659 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-587ff95a-16e1-465d-8588-5f72e479526c tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:32.877491 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-69634a0d-3c90-48ee-a85c-331a9f9edd1c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:32.886164 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-69634a0d-3c90-48ee-a85c-331a9f9edd1c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1750 microversion: 2.1 time: 0.246333 Jul 31 14:27:32.886841 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 317/646] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:32 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1750 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:33.013474 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-587ff95a-16e1-465d-8588-5f72e479526c tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:33.021761 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-587ff95a-16e1-465d-8588-5f72e479526c tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1566 microversion: 2.1 time: 0.161049 Jul 31 14:27:33.022560 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 330/647] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:32 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:27:33.908207 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-28a37bf2-b9ee-49f0-a86a-0d2147ea9da6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:33.908822 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-28a37bf2-b9ee-49f0-a86a-0d2147ea9da6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:33.915962 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-28a37bf2-b9ee-49f0-a86a-0d2147ea9da6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:33.916411 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-28a37bf2-b9ee-49f0-a86a-0d2147ea9da6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:33.917179 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-28a37bf2-b9ee-49f0-a86a-0d2147ea9da6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:33.917618 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-28a37bf2-b9ee-49f0-a86a-0d2147ea9da6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:34.042023 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3a6e1108-8b93-47ce-be2a-87054b87a76c tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:34.042635 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3a6e1108-8b93-47ce-be2a-87054b87a76c tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:34.045148 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=60 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:27:34.051200 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3a6e1108-8b93-47ce-be2a-87054b87a76c tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:34.051853 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3a6e1108-8b93-47ce-be2a-87054b87a76c tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:34.052665 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3a6e1108-8b93-47ce-be2a-87054b87a76c tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:34.053074 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3a6e1108-8b93-47ce-be2a-87054b87a76c tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:34.063327 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-28a37bf2-b9ee-49f0-a86a-0d2147ea9da6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:34.073008 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-28a37bf2-b9ee-49f0-a86a-0d2147ea9da6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1755 microversion: 2.1 time: 0.168629 Jul 31 14:27:34.073687 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 318/648] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:33 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:27:34.183977 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3a6e1108-8b93-47ce-be2a-87054b87a76c tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:34.191345 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3a6e1108-8b93-47ce-be2a-87054b87a76c tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1566 microversion: 2.1 time: 0.153155 Jul 31 14:27:34.192017 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 331/649] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:34 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:27:35.095677 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b13f2ae5-0954-408d-9a02-40abb7c2404c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:35.096063 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b13f2ae5-0954-408d-9a02-40abb7c2404c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:35.103241 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b13f2ae5-0954-408d-9a02-40abb7c2404c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:35.103725 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b13f2ae5-0954-408d-9a02-40abb7c2404c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:35.104496 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b13f2ae5-0954-408d-9a02-40abb7c2404c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:35.104936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b13f2ae5-0954-408d-9a02-40abb7c2404c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:35.212467 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a2583950-81e0-417a-b2b9-da6f9a52d6ea tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:35.213233 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a2583950-81e0-417a-b2b9-da6f9a52d6ea tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:35.219776 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a2583950-81e0-417a-b2b9-da6f9a52d6ea tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:35.220304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a2583950-81e0-417a-b2b9-da6f9a52d6ea tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:35.221159 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a2583950-81e0-417a-b2b9-da6f9a52d6ea tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:35.222157 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a2583950-81e0-417a-b2b9-da6f9a52d6ea tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:35.249299 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b13f2ae5-0954-408d-9a02-40abb7c2404c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:35.257526 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b13f2ae5-0954-408d-9a02-40abb7c2404c tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1755 microversion: 2.1 time: 0.166020 Jul 31 14:27:35.258106 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 319/650] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:35 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:35.351807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a2583950-81e0-417a-b2b9-da6f9a52d6ea tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:35.359115 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a2583950-81e0-417a-b2b9-da6f9a52d6ea tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1566 microversion: 2.1 time: 0.150558 Jul 31 14:27:35.359795 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 332/651] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:35 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:27:36.280394 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-c029b233-b797-4bce-8264-0347fc0b2be6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:36.281123 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-c029b233-b797-4bce-8264-0347fc0b2be6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:36.290070 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c029b233-b797-4bce-8264-0347fc0b2be6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:36.290522 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c029b233-b797-4bce-8264-0347fc0b2be6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:36.291291 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c029b233-b797-4bce-8264-0347fc0b2be6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:36.291762 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c029b233-b797-4bce-8264-0347fc0b2be6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:36.381317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b13d2468-f3dd-4ee1-9dcd-769346b35022 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:36.381962 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b13d2468-f3dd-4ee1-9dcd-769346b35022 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:36.388507 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b13d2468-f3dd-4ee1-9dcd-769346b35022 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:36.388954 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b13d2468-f3dd-4ee1-9dcd-769346b35022 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:36.389712 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b13d2468-f3dd-4ee1-9dcd-769346b35022 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:36.390145 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b13d2468-f3dd-4ee1-9dcd-769346b35022 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:36.434248 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c029b233-b797-4bce-8264-0347fc0b2be6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:36.442767 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-c029b233-b797-4bce-8264-0347fc0b2be6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1755 microversion: 2.1 time: 0.167927 Jul 31 14:27:36.443340 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 320/652] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:36 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:27:36.524006 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b13d2468-f3dd-4ee1-9dcd-769346b35022 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:36.531313 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b13d2468-f3dd-4ee1-9dcd-769346b35022 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1566 microversion: 2.1 time: 0.154502 Jul 31 14:27:36.531906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 333/653] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:36 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:27:37.463277 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-93aadaf8-f809-4f7c-975e-0ebbeae6d0de tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:37.463845 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-93aadaf8-f809-4f7c-975e-0ebbeae6d0de tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:37.470280 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-93aadaf8-f809-4f7c-975e-0ebbeae6d0de tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:37.470727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-93aadaf8-f809-4f7c-975e-0ebbeae6d0de tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:37.471536 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-93aadaf8-f809-4f7c-975e-0ebbeae6d0de tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:37.471979 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-93aadaf8-f809-4f7c-975e-0ebbeae6d0de tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:37.552761 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-977fcdd2-d539-41f3-8745-d88492104131 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:37.553379 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-977fcdd2-d539-41f3-8745-d88492104131 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:37.560095 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-977fcdd2-d539-41f3-8745-d88492104131 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:37.560541 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-977fcdd2-d539-41f3-8745-d88492104131 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:37.561309 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-977fcdd2-d539-41f3-8745-d88492104131 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:37.561745 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-977fcdd2-d539-41f3-8745-d88492104131 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:37.615225 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-93aadaf8-f809-4f7c-975e-0ebbeae6d0de tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:37.623664 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-93aadaf8-f809-4f7c-975e-0ebbeae6d0de tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1755 microversion: 2.1 time: 0.164291 Jul 31 14:27:37.624248 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 321/654] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:37 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:37.694740 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-977fcdd2-d539-41f3-8745-d88492104131 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:37.702416 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-977fcdd2-d539-41f3-8745-d88492104131 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1566 microversion: 2.1 time: 0.153681 Jul 31 14:27:37.702981 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 334/655] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:37 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:27:38.646127 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-56e8fee2-2558-4670-ba19-eced76705c2f tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:38.646766 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-56e8fee2-2558-4670-ba19-eced76705c2f tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:38.653429 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-56e8fee2-2558-4670-ba19-eced76705c2f tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:38.653875 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-56e8fee2-2558-4670-ba19-eced76705c2f tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:38.654633 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-56e8fee2-2558-4670-ba19-eced76705c2f tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:38.655065 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-56e8fee2-2558-4670-ba19-eced76705c2f tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:38.724379 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ce9dc351-55d5-4f8f-a0f0-78df6d7ea613 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:38.725740 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ce9dc351-55d5-4f8f-a0f0-78df6d7ea613 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:38.733080 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ce9dc351-55d5-4f8f-a0f0-78df6d7ea613 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:38.733826 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ce9dc351-55d5-4f8f-a0f0-78df6d7ea613 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:38.734826 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ce9dc351-55d5-4f8f-a0f0-78df6d7ea613 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:38.735538 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ce9dc351-55d5-4f8f-a0f0-78df6d7ea613 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:38.928163 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ce9dc351-55d5-4f8f-a0f0-78df6d7ea613 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:38.935923 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ce9dc351-55d5-4f8f-a0f0-78df6d7ea613 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1566 microversion: 2.1 time: 0.216417 Jul 31 14:27:38.936501 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 335/656] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:38 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1566 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:39.004381 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-56e8fee2-2558-4670-ba19-eced76705c2f tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:39.012302 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-56e8fee2-2558-4670-ba19-eced76705c2f tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1755 microversion: 2.1 time: 0.370492 Jul 31 14:27:39.012882 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 322/657] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:38 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1755 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:39.959949 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-274cad05-8b77-457e-9280-95bd3113de4e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:39.960574 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-274cad05-8b77-457e-9280-95bd3113de4e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:39.967050 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-274cad05-8b77-457e-9280-95bd3113de4e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:39.967532 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-274cad05-8b77-457e-9280-95bd3113de4e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:39.968302 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-274cad05-8b77-457e-9280-95bd3113de4e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:39.968739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-274cad05-8b77-457e-9280-95bd3113de4e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:40.034775 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-d230ccd7-f838-4f61-91e7-30e0083b11ce tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:40.035478 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-d230ccd7-f838-4f61-91e7-30e0083b11ce tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:40.042217 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d230ccd7-f838-4f61-91e7-30e0083b11ce tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:40.042669 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d230ccd7-f838-4f61-91e7-30e0083b11ce tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:40.043513 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d230ccd7-f838-4f61-91e7-30e0083b11ce tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:40.043980 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d230ccd7-f838-4f61-91e7-30e0083b11ce tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:40.100041 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-274cad05-8b77-457e-9280-95bd3113de4e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:40.107637 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-274cad05-8b77-457e-9280-95bd3113de4e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1566 microversion: 2.1 time: 0.151924 Jul 31 14:27:40.108209 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 336/658] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:39 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:40.198571 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-d230ccd7-f838-4f61-91e7-30e0083b11ce tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:40.207337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-d230ccd7-f838-4f61-91e7-30e0083b11ce tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1755 microversion: 2.1 time: 0.177099 Jul 31 14:27:40.208011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 323/659] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:40 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:27:40.314322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7192fc43-79a7-446a-be4f-d37199ae35ce tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:40.314828 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7192fc43-79a7-446a-be4f-d37199ae35ce tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:40.321577 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7192fc43-79a7-446a-be4f-d37199ae35ce tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:40.322016 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7192fc43-79a7-446a-be4f-d37199ae35ce tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:40.322768 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7192fc43-79a7-446a-be4f-d37199ae35ce tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:40.323197 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7192fc43-79a7-446a-be4f-d37199ae35ce tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:40.347317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7192fc43-79a7-446a-be4f-d37199ae35ce tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07/ips" status: 200 len: 150 microversion: 2.1 time: 0.036829 Jul 31 14:27:40.347913 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 337/660] 10.222.0.40 () {58 vars in 1248 bytes} [Sun Jul 31 14:27:40 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:27:41.128672 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-16cba164-7e4d-47cd-9bae-79fdae6f270d tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:41.129277 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-16cba164-7e4d-47cd-9bae-79fdae6f270d tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:41.135691 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-16cba164-7e4d-47cd-9bae-79fdae6f270d tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:41.136139 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-16cba164-7e4d-47cd-9bae-79fdae6f270d tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:41.136897 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-16cba164-7e4d-47cd-9bae-79fdae6f270d tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:41.137330 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-16cba164-7e4d-47cd-9bae-79fdae6f270d tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:41.228454 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-58909349-dca5-49e6-afb3-7636b3ab1ed2 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:41.229063 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-58909349-dca5-49e6-afb3-7636b3ab1ed2 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:41.235231 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-58909349-dca5-49e6-afb3-7636b3ab1ed2 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:41.235695 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-58909349-dca5-49e6-afb3-7636b3ab1ed2 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:41.236452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-58909349-dca5-49e6-afb3-7636b3ab1ed2 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:41.236880 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-58909349-dca5-49e6-afb3-7636b3ab1ed2 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:41.265728 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-16cba164-7e4d-47cd-9bae-79fdae6f270d tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:41.274223 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-16cba164-7e4d-47cd-9bae-79fdae6f270d tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1566 microversion: 2.1 time: 0.149407 Jul 31 14:27:41.274798 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 324/661] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:41 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:41.385196 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-58909349-dca5-49e6-afb3-7636b3ab1ed2 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:41.393842 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-58909349-dca5-49e6-afb3-7636b3ab1ed2 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1755 microversion: 2.1 time: 0.168658 Jul 31 14:27:41.394520 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 338/662] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:41 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:27:41.681165 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-62861fa5-3e78-4cb5-a9c3-7a2660b435c9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ddf603ed-6afb-4637-b101-1d5fb429a9c9"}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:27:41.683674 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-62861fa5-3e78-4cb5-a9c3-7a2660b435c9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:41.689687 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-62861fa5-3e78-4cb5-a9c3-7a2660b435c9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:41.690159 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-62861fa5-3e78-4cb5-a9c3-7a2660b435c9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:41.690923 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-62861fa5-3e78-4cb5-a9c3-7a2660b435c9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:41.691362 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-62861fa5-3e78-4cb5-a9c3-7a2660b435c9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:42.081560 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-62861fa5-3e78-4cb5-a9c3-7a2660b435c9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "POST /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.403661 Jul 31 14:27:42.082232 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 325/663] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Jul 31 14:27:41 2022] POST /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07/os-volume_attachments => generated 194 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:27:42.295542 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-65faee60-b1ba-494f-a3df-d60ad01e931f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:42.296154 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-65faee60-b1ba-494f-a3df-d60ad01e931f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:42.303132 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-65faee60-b1ba-494f-a3df-d60ad01e931f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:42.303614 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-65faee60-b1ba-494f-a3df-d60ad01e931f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:42.304371 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-65faee60-b1ba-494f-a3df-d60ad01e931f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:42.304807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-65faee60-b1ba-494f-a3df-d60ad01e931f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:42.415520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-62b16381-9728-4d41-a26b-b668e74961c2 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:42.416223 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-62b16381-9728-4d41-a26b-b668e74961c2 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:42.422405 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-62b16381-9728-4d41-a26b-b668e74961c2 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:42.422861 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-62b16381-9728-4d41-a26b-b668e74961c2 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:42.423672 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-62b16381-9728-4d41-a26b-b668e74961c2 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:42.424099 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-62b16381-9728-4d41-a26b-b668e74961c2 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:42.442736 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-65faee60-b1ba-494f-a3df-d60ad01e931f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:42.443866 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:27:42.451001 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-65faee60-b1ba-494f-a3df-d60ad01e931f tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1507 microversion: 2.1 time: 0.158934 Jul 31 14:27:42.451791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 339/664] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:42 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:42.471588 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-727d534a-e4d2-472f-a305-62929ffd6182 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:27:42.472187 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-727d534a-e4d2-472f-a305-62929ffd6182 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:42.478115 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-727d534a-e4d2-472f-a305-62929ffd6182 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:42.478566 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-727d534a-e4d2-472f-a305-62929ffd6182 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:42.479334 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-727d534a-e4d2-472f-a305-62929ffd6182 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:42.479830 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-727d534a-e4d2-472f-a305-62929ffd6182 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:42.522905 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-727d534a-e4d2-472f-a305-62929ffd6182 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117780) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 31 14:27:42.575778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-62b16381-9728-4d41-a26b-b668e74961c2 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:42.584070 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-62b16381-9728-4d41-a26b-b668e74961c2 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1755 microversion: 2.1 time: 0.173300 Jul 31 14:27:42.584664 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 326/665] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:42 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:27:42.592319 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-727d534a-e4d2-472f-a305-62929ffd6182 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "POST /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73/action" status: 202 len: 0 microversion: 2.1 time: 0.124272 Jul 31 14:27:42.593109 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 340/666] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Jul 31 14:27:42 2022] POST /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 14:27:42.603975 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-fb5a2784-0ebb-4142-804b-619d6ade3f12 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:42.604552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-fb5a2784-0ebb-4142-804b-619d6ade3f12 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:42.610589 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fb5a2784-0ebb-4142-804b-619d6ade3f12 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:42.611114 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fb5a2784-0ebb-4142-804b-619d6ade3f12 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:42.611936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fb5a2784-0ebb-4142-804b-619d6ade3f12 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:42.612943 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fb5a2784-0ebb-4142-804b-619d6ade3f12 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:42.792425 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-fb5a2784-0ebb-4142-804b-619d6ade3f12 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:42.801753 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-fb5a2784-0ebb-4142-804b-619d6ade3f12 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1515 microversion: 2.1 time: 0.201840 Jul 31 14:27:42.802331 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 327/667] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:42 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1515 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:43.608138 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-384ede2a-89b8-42fd-b47e-2b0190a36b2f tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:43.608758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-384ede2a-89b8-42fd-b47e-2b0190a36b2f tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:43.615820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-384ede2a-89b8-42fd-b47e-2b0190a36b2f tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:43.616272 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-384ede2a-89b8-42fd-b47e-2b0190a36b2f tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:43.617114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-384ede2a-89b8-42fd-b47e-2b0190a36b2f tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:43.617559 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-384ede2a-89b8-42fd-b47e-2b0190a36b2f tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:43.761227 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-384ede2a-89b8-42fd-b47e-2b0190a36b2f tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:43.769317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-384ede2a-89b8-42fd-b47e-2b0190a36b2f tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1755 microversion: 2.1 time: 0.165015 Jul 31 14:27:43.769823 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 341/668] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:43 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:43.824531 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-1d26cbc8-1d7c-45a0-9866-30ee0cf751dc tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:43.825174 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-1d26cbc8-1d7c-45a0-9866-30ee0cf751dc tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:43.827731 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:27:43.833579 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1d26cbc8-1d7c-45a0-9866-30ee0cf751dc tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:43.834028 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1d26cbc8-1d7c-45a0-9866-30ee0cf751dc tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:43.834785 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1d26cbc8-1d7c-45a0-9866-30ee0cf751dc tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:43.835225 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1d26cbc8-1d7c-45a0-9866-30ee0cf751dc tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:43.967618 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-1d26cbc8-1d7c-45a0-9866-30ee0cf751dc tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:43.975618 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-1d26cbc8-1d7c-45a0-9866-30ee0cf751dc tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1517 microversion: 2.1 time: 0.154970 Jul 31 14:27:43.976185 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 328/669] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:43 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:27:44.789994 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a66d18b9-297f-4b53-ab7d-d47ebd70d4d6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:44.790737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a66d18b9-297f-4b53-ab7d-d47ebd70d4d6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:44.796965 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a66d18b9-297f-4b53-ab7d-d47ebd70d4d6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:44.797499 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a66d18b9-297f-4b53-ab7d-d47ebd70d4d6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:44.798245 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a66d18b9-297f-4b53-ab7d-d47ebd70d4d6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:44.798672 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a66d18b9-297f-4b53-ab7d-d47ebd70d4d6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:44.936422 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a66d18b9-297f-4b53-ab7d-d47ebd70d4d6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:44.944708 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a66d18b9-297f-4b53-ab7d-d47ebd70d4d6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1755 microversion: 2.1 time: 0.158503 Jul 31 14:27:44.945274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 342/670] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:44 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:27:44.997438 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-404ff329-8c8a-4a27-be30-d04946f47895 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:44.998179 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-404ff329-8c8a-4a27-be30-d04946f47895 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:45.005106 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-404ff329-8c8a-4a27-be30-d04946f47895 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:45.005550 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-404ff329-8c8a-4a27-be30-d04946f47895 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:45.006308 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-404ff329-8c8a-4a27-be30-d04946f47895 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:45.006739 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-404ff329-8c8a-4a27-be30-d04946f47895 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:45.135145 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-404ff329-8c8a-4a27-be30-d04946f47895 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:45.142676 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-404ff329-8c8a-4a27-be30-d04946f47895 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1517 microversion: 2.1 time: 0.149013 Jul 31 14:27:45.143250 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 329/671] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:44 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1517 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:45.955204 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-cc06e854-a4b9-4e41-ada7-add6ddaf61a1 req-d7c5d601-17ad-4f5d-a42c-3a8a4a17d936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92439dcd-76b3-44fb-882b-1b8f0dcb9d73", "name": "network-vif-unplugged", "status": "completed", "tag": "e91303da-f1e0-49da-acae-3ce6750984f8"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:27:45.966543 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-4f81d927-d080-42c1-8a9b-8be848f3c284 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:45.967157 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-4f81d927-d080-42c1-8a9b-8be848f3c284 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:45.974595 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4f81d927-d080-42c1-8a9b-8be848f3c284 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:45.975041 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4f81d927-d080-42c1-8a9b-8be848f3c284 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:45.975835 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4f81d927-d080-42c1-8a9b-8be848f3c284 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:45.976274 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-4f81d927-d080-42c1-8a9b-8be848f3c284 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:45.983839 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-cc06e854-a4b9-4e41-ada7-add6ddaf61a1 req-d7c5d601-17ad-4f5d-a42c-3a8a4a17d936 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:45.984291 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-cc06e854-a4b9-4e41-ada7-add6ddaf61a1 req-d7c5d601-17ad-4f5d-a42c-3a8a4a17d936 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:45.996215 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.compute.server_external_events [req-cc06e854-a4b9-4e41-ada7-add6ddaf61a1 req-d7c5d601-17ad-4f5d-a42c-3a8a4a17d936 service nova] Unable to find a host for instance 92439dcd-76b3-44fb-882b-1b8f0dcb9d73. Dropping event network-vif-unplugged {{(pid=117780) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 31 14:27:45.997091 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-cc06e854-a4b9-4e41-ada7-add6ddaf61a1 req-d7c5d601-17ad-4f5d-a42c-3a8a4a17d936 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045878 Jul 31 14:27:45.997684 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 343/672] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 48 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 31 14:27:46.164764 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a7903947-ddf5-48de-bb68-962560be7b78 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:46.165421 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a7903947-ddf5-48de-bb68-962560be7b78 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:46.172006 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a7903947-ddf5-48de-bb68-962560be7b78 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:46.172451 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a7903947-ddf5-48de-bb68-962560be7b78 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:46.173229 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a7903947-ddf5-48de-bb68-962560be7b78 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:46.173663 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a7903947-ddf5-48de-bb68-962560be7b78 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:46.311596 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a7903947-ddf5-48de-bb68-962560be7b78 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:46.320041 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a7903947-ddf5-48de-bb68-962560be7b78 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1517 microversion: 2.1 time: 0.159324 Jul 31 14:27:46.320805 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 344/673] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:46 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:27:46.373096 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-4f81d927-d080-42c1-8a9b-8be848f3c284 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:46.381603 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-4f81d927-d080-42c1-8a9b-8be848f3c284 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1755 microversion: 2.1 time: 0.419042 Jul 31 14:27:46.382177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 330/674] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:45 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1755 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:27:47.341262 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-090fae89-3afc-4dfd-b2ba-48552888d53b tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:47.341872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-090fae89-3afc-4dfd-b2ba-48552888d53b tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:47.348433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-090fae89-3afc-4dfd-b2ba-48552888d53b tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:47.348886 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-090fae89-3afc-4dfd-b2ba-48552888d53b tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:47.349646 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-090fae89-3afc-4dfd-b2ba-48552888d53b tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:47.350083 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-090fae89-3afc-4dfd-b2ba-48552888d53b tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:47.354036 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:27:47.404568 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-9167b5c5-285e-444e-8bfd-5ee0788e080d tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:47.405100 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-9167b5c5-285e-444e-8bfd-5ee0788e080d tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:47.412293 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9167b5c5-285e-444e-8bfd-5ee0788e080d tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:47.412744 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9167b5c5-285e-444e-8bfd-5ee0788e080d tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:47.413661 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9167b5c5-285e-444e-8bfd-5ee0788e080d tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:47.414103 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9167b5c5-285e-444e-8bfd-5ee0788e080d tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:47.500164 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-090fae89-3afc-4dfd-b2ba-48552888d53b tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:47.508407 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-090fae89-3afc-4dfd-b2ba-48552888d53b tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1517 microversion: 2.1 time: 0.170946 Jul 31 14:27:47.508974 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 345/675] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:47 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:47.574431 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-9167b5c5-285e-444e-8bfd-5ee0788e080d tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:47.582767 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-9167b5c5-285e-444e-8bfd-5ee0788e080d tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1755 microversion: 2.1 time: 0.183226 Jul 31 14:27:47.583343 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 331/676] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:47 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:27:48.529205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-19a5d733-70e6-42a8-ab80-932a200f9ba1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:48.529750 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-19a5d733-70e6-42a8-ab80-932a200f9ba1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:48.536499 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-19a5d733-70e6-42a8-ab80-932a200f9ba1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:48.537278 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-19a5d733-70e6-42a8-ab80-932a200f9ba1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:48.538051 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-19a5d733-70e6-42a8-ab80-932a200f9ba1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:48.538512 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-19a5d733-70e6-42a8-ab80-932a200f9ba1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:48.603914 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-fee2dde2-0847-4b5b-998d-c826ad4537e4 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:48.604520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-fee2dde2-0847-4b5b-998d-c826ad4537e4 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:48.610808 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fee2dde2-0847-4b5b-998d-c826ad4537e4 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:48.611257 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fee2dde2-0847-4b5b-998d-c826ad4537e4 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:48.612059 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fee2dde2-0847-4b5b-998d-c826ad4537e4 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:48.612488 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-fee2dde2-0847-4b5b-998d-c826ad4537e4 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:48.671626 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-19a5d733-70e6-42a8-ab80-932a200f9ba1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:48.679048 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-19a5d733-70e6-42a8-ab80-932a200f9ba1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1517 microversion: 2.1 time: 0.153814 Jul 31 14:27:48.679658 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 346/677] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:48 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:27:48.764277 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-fee2dde2-0847-4b5b-998d-c826ad4537e4 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:48.772918 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-fee2dde2-0847-4b5b-998d-c826ad4537e4 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1755 microversion: 2.1 time: 0.172830 Jul 31 14:27:48.773488 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 332/678] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:48 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:27:49.720237 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-aeec7624-e1ba-41a0-99b6-4220198bff28 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ddf603ed-6afb-4637-b101-1d5fb429a9c9"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:27:49.723153 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-aeec7624-e1ba-41a0-99b6-4220198bff28 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:49.729545 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aeec7624-e1ba-41a0-99b6-4220198bff28 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:49.729983 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aeec7624-e1ba-41a0-99b6-4220198bff28 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:49.730731 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aeec7624-e1ba-41a0-99b6-4220198bff28 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:49.731159 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-aeec7624-e1ba-41a0-99b6-4220198bff28 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:49.758066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-e0f832df-0038-4834-a8e0-62173841d03a tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:49.759910 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-e0f832df-0038-4834-a8e0-62173841d03a tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:49.766761 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e0f832df-0038-4834-a8e0-62173841d03a tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:49.767266 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e0f832df-0038-4834-a8e0-62173841d03a tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:49.768121 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e0f832df-0038-4834-a8e0-62173841d03a tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:49.768572 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e0f832df-0038-4834-a8e0-62173841d03a tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:49.814052 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-aeec7624-e1ba-41a0-99b6-4220198bff28 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] HTTP exception thrown: Invalid volume: volume ddf603ed-6afb-4637-b101-1d5fb429a9c9 is already attached to instances: b65263c9-40f6-48e3-9e44-b8654f688d07 Jul 31 14:27:49.815872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-aeec7624-e1ba-41a0-99b6-4220198bff28 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Request method failure captured: Jul 31 14:27:49.815872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: POST /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07/os-volume_attachments HTTP/1.1 Jul 31 14:27:49.815872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:27:49.815872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:27:49.815872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:27:49.815872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 74 Jul 31 14:27:49.815872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:27:49.815872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:27:49.815872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:27:49.815872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:27:49.815872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pA3RnV2a-dDWWL-_ZfxXcr4UktgQI-9SWPGN4xUIh3gpaTPpUlCMNWU1g96nJfR_a1KYUrPG43SkpeWWkH3LXQwcjtBN7d_0kQ02fiRqueKY6XZVQNh8gR0_ddCj_gKuHBtsN430P5RXgDqCVuPQ_rcT-N1y6dWBKzFpQGKjlxkqC0 Jul 31 14:27:49.815872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:27:49.815872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:27:49.815872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:27:49.815872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:27:49.815872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:27:49.815872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:27:49.815872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:27:49.815872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:27:49.815872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:27:49.815872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:27:49.817973 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9097fd66951e457ba46812ff17db7501", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9097fd66951e457ba46812ff17db7501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:27:49.817973 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:27:49.817973 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:27:49.817973 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:27:49.817973 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:27:49.817973 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:27:49.817973 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:27:49.817973 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: d6e8399080a942f1b689fc8c6b42c717 Jul 31 14:27:49.817973 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:27:49.817973 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Jul 31 14:27:49.817973 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {"volumeAttachment": {"volumeId": "ddf603ed-6afb-4637-b101-1d5fb429a9c9"}} Jul 31 14:27:49.817973 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:27:49.818812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Invalid volume: volume ddf603ed-6afb-4637-b101-1d5fb429a9c9 is already attached to instances: b65263c9-40f6-48e3-9e44-b8654f688d07 Jul 31 14:27:49.818812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'server_id': 'b65263c9-40f6-48e3-9e44-b8654f688d07', 'body': {'volumeAttachment': {'volumeId': 'ddf603ed-6afb-4637-b101-1d5fb429a9c9'}}} Jul 31 14:27:49.818812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:27:49.818812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:27:49.818812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 31 14:27:49.818812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 31 14:27:49.818812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 31 14:27:49.818812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 31 14:27:49.818812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 31 14:27:49.818812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 31 14:27:49.818812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 31 14:27:49.818812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 31 14:27:49.818812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 31 14:27:49.818812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 31 14:27:49.818812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ddf603ed-6afb-4637-b101-1d5fb429a9c9 is already attached to instances: b65263c9-40f6-48e3-9e44-b8654f688d07 Jul 31 14:27:49.818812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:27:49.818812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:27:49.818812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:27:49.818812 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:27:49.820628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:27:49.820628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:27:49.820628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:27:49.820628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:27:49.820628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:27:49.820628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:27:49.820628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 14:27:49.820628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 14:27:49.820628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 14:27:49.820628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 14:27:49.820628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 31 14:27:49.820628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 31 14:27:49.820628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 31 14:27:49.820628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 31 14:27:49.820628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ddf603ed-6afb-4637-b101-1d5fb429a9c9 is already attached to instances: b65263c9-40f6-48e3-9e44-b8654f688d07 Jul 31 14:27:49.820628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:27:49.820628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:27:49.820628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:27:49.820628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:27:49.820628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:27:49.823303 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:27:49.823303 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:27:49.823303 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:27:49.823303 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ddf603ed-6afb-4637-b101-1d5fb429a9c9 is already attached to instances: b65263c9-40f6-48e3-9e44-b8654f688d07 Jul 31 14:27:49.823303 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:27:49.823303 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-aeec7624-e1ba-41a0-99b6-4220198bff28 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Returning 400 to user: Invalid volume: volume ddf603ed-6afb-4637-b101-1d5fb429a9c9 is already attached to instances: b65263c9-40f6-48e3-9e44-b8654f688d07 {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:27:49.823303 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-aeec7624-e1ba-41a0-99b6-4220198bff28 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "POST /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100988 Jul 31 14:27:49.823303 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 347/679] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Jul 31 14:27:49 2022] POST /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 31 14:27:49.825664 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5a6b6b3d-a8c3-4c9e-a1b7-c46fc551323b tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:49.826242 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-5a6b6b3d-a8c3-4c9e-a1b7-c46fc551323b tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:49.832997 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5a6b6b3d-a8c3-4c9e-a1b7-c46fc551323b tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:49.833443 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5a6b6b3d-a8c3-4c9e-a1b7-c46fc551323b tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:49.834219 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5a6b6b3d-a8c3-4c9e-a1b7-c46fc551323b tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:49.834684 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5a6b6b3d-a8c3-4c9e-a1b7-c46fc551323b tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:49.938593 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e0f832df-0038-4834-a8e0-62173841d03a tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:49.946248 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-e0f832df-0038-4834-a8e0-62173841d03a tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1517 microversion: 2.1 time: 0.191994 Jul 31 14:27:49.946826 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 333/680] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:49 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1517 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:27:49.951739 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-0705d87e-bb5c-4abb-953d-41d5ab397c03 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:49.952430 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-0705d87e-bb5c-4abb-953d-41d5ab397c03 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:49.958765 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0705d87e-bb5c-4abb-953d-41d5ab397c03 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:49.959213 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0705d87e-bb5c-4abb-953d-41d5ab397c03 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:49.960005 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0705d87e-bb5c-4abb-953d-41d5ab397c03 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:49.960611 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0705d87e-bb5c-4abb-953d-41d5ab397c03 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:50.004406 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-5a6b6b3d-a8c3-4c9e-a1b7-c46fc551323b tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:50.012580 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-5a6b6b3d-a8c3-4c9e-a1b7-c46fc551323b tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1758 microversion: 2.1 time: 0.190721 Jul 31 14:27:50.013248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 348/681] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:49 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1758 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:50.082968 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.objects.instance [None req-0705d87e-bb5c-4abb-953d-41d5ab397c03 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lazy-loading 'services' on Instance uuid b65263c9-40f6-48e3-9e44-b8654f688d07 {{(pid=117781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:27:50.194258 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-0705d87e-bb5c-4abb-953d-41d5ab397c03 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07/os-volume_attachments/ddf603ed-6afb-4637-b101-1d5fb429a9c9" status: 202 len: 0 microversion: 2.1 time: 0.246111 Jul 31 14:27:50.194750 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 334/682] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Jul 31 14:27:49 2022] DELETE /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07/os-volume_attachments/ddf603ed-6afb-4637-b101-1d5fb429a9c9 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:27:50.206217 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d37a3bfa-e7b8-4b0e-8b18-09dde39dbca3 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:50.210203 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d37a3bfa-e7b8-4b0e-8b18-09dde39dbca3 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:50.218265 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d37a3bfa-e7b8-4b0e-8b18-09dde39dbca3 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:50.218720 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d37a3bfa-e7b8-4b0e-8b18-09dde39dbca3 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:50.219565 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d37a3bfa-e7b8-4b0e-8b18-09dde39dbca3 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:50.219998 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d37a3bfa-e7b8-4b0e-8b18-09dde39dbca3 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:50.248377 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d37a3bfa-e7b8-4b0e-8b18-09dde39dbca3 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046093 Jul 31 14:27:50.248928 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 349/683] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Jul 31 14:27:50 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:27:50.969414 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-a9616ea2-6ddf-434c-983d-e92967b333c4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:50.970108 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-a9616ea2-6ddf-434c-983d-e92967b333c4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:50.976861 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a9616ea2-6ddf-434c-983d-e92967b333c4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:50.977381 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a9616ea2-6ddf-434c-983d-e92967b333c4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:50.978135 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a9616ea2-6ddf-434c-983d-e92967b333c4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:50.978574 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a9616ea2-6ddf-434c-983d-e92967b333c4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:51.108890 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a9616ea2-6ddf-434c-983d-e92967b333c4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:51.117028 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-a9616ea2-6ddf-434c-983d-e92967b333c4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1573 microversion: 2.1 time: 0.152313 Jul 31 14:27:51.117616 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 335/684] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:50 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:51.260715 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1a0f57d9-800a-4818-a015-0fbb149ff7cd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:51.262862 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1a0f57d9-800a-4818-a015-0fbb149ff7cd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:51.269844 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1a0f57d9-800a-4818-a015-0fbb149ff7cd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:51.270301 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1a0f57d9-800a-4818-a015-0fbb149ff7cd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:51.271064 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1a0f57d9-800a-4818-a015-0fbb149ff7cd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:51.271542 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1a0f57d9-800a-4818-a015-0fbb149ff7cd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:51.301176 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1a0f57d9-800a-4818-a015-0fbb149ff7cd tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044388 Jul 31 14:27:51.301977 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 350/685] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Jul 31 14:27:51 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:27:52.138020 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7f2fb5d8-b6ff-4dba-8bd9-fbd38bcbd4fe tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:52.138631 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7f2fb5d8-b6ff-4dba-8bd9-fbd38bcbd4fe tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:52.145264 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7f2fb5d8-b6ff-4dba-8bd9-fbd38bcbd4fe tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:52.146208 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7f2fb5d8-b6ff-4dba-8bd9-fbd38bcbd4fe tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:52.146482 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7f2fb5d8-b6ff-4dba-8bd9-fbd38bcbd4fe tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:52.146919 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7f2fb5d8-b6ff-4dba-8bd9-fbd38bcbd4fe tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:52.314585 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ebdbe502-d896-4894-9b36-a4be7bec271c tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:52.316958 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ebdbe502-d896-4894-9b36-a4be7bec271c tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:52.326163 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ebdbe502-d896-4894-9b36-a4be7bec271c tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:52.326842 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ebdbe502-d896-4894-9b36-a4be7bec271c tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:52.328049 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ebdbe502-d896-4894-9b36-a4be7bec271c tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:52.328740 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ebdbe502-d896-4894-9b36-a4be7bec271c tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:52.370145 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ebdbe502-d896-4894-9b36-a4be7bec271c tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060110 Jul 31 14:27:52.370962 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 351/686] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Jul 31 14:27:52 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 31 14:27:52.380522 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7f2fb5d8-b6ff-4dba-8bd9-fbd38bcbd4fe tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:52.388437 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7f2fb5d8-b6ff-4dba-8bd9-fbd38bcbd4fe tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1573 microversion: 2.1 time: 0.253608 Jul 31 14:27:52.389340 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 336/687] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:52 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1573 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:52.445527 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b0ee4729-cd0b-4ced-ad04-65f2303d2844 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:52.446016 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b0ee4729-cd0b-4ced-ad04-65f2303d2844 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:52.452177 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b0ee4729-cd0b-4ced-ad04-65f2303d2844 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:52.452622 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b0ee4729-cd0b-4ced-ad04-65f2303d2844 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:52.453371 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b0ee4729-cd0b-4ced-ad04-65f2303d2844 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:52.453798 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b0ee4729-cd0b-4ced-ad04-65f2303d2844 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:52.477866 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b0ee4729-cd0b-4ced-ad04-65f2303d2844 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Going to try to terminate instance {{(pid=117780) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 14:27:52.555585 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b0ee4729-cd0b-4ced-ad04-65f2303d2844 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07" status: 204 len: 0 microversion: 2.1 time: 0.113576 Jul 31 14:27:52.556156 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 352/688] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:27:52 2022] DELETE /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 14:27:52.564163 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-6f65acc9-9f5c-43b8-9532-6ddf0c5e55a8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:52.564822 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-6f65acc9-9f5c-43b8-9532-6ddf0c5e55a8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:52.570676 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6f65acc9-9f5c-43b8-9532-6ddf0c5e55a8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:52.571123 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6f65acc9-9f5c-43b8-9532-6ddf0c5e55a8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:52.571940 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6f65acc9-9f5c-43b8-9532-6ddf0c5e55a8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:52.572381 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6f65acc9-9f5c-43b8-9532-6ddf0c5e55a8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:52.703682 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-6f65acc9-9f5c-43b8-9532-6ddf0c5e55a8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:52.711674 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-6f65acc9-9f5c-43b8-9532-6ddf0c5e55a8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07" status: 200 len: 1679 microversion: 2.1 time: 0.151218 Jul 31 14:27:52.712245 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 337/689] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:52 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:53.412894 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2918e36e-92bd-46d3-9c19-9ec71b353eab tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:53.413508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2918e36e-92bd-46d3-9c19-9ec71b353eab tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:53.420250 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2918e36e-92bd-46d3-9c19-9ec71b353eab tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:53.420691 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2918e36e-92bd-46d3-9c19-9ec71b353eab tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:53.421446 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2918e36e-92bd-46d3-9c19-9ec71b353eab tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:53.421875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2918e36e-92bd-46d3-9c19-9ec71b353eab tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:53.555930 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2918e36e-92bd-46d3-9c19-9ec71b353eab tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:53.563660 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2918e36e-92bd-46d3-9c19-9ec71b353eab tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1573 microversion: 2.1 time: 0.154858 Jul 31 14:27:53.564235 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 353/690] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:53 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:53.733647 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-23f6072e-1347-40e9-9c4a-41fecaed7135 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:53.734289 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-23f6072e-1347-40e9-9c4a-41fecaed7135 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:53.741616 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-23f6072e-1347-40e9-9c4a-41fecaed7135 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:53.742133 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-23f6072e-1347-40e9-9c4a-41fecaed7135 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:53.742989 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-23f6072e-1347-40e9-9c4a-41fecaed7135 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:53.743509 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-23f6072e-1347-40e9-9c4a-41fecaed7135 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:53.874115 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-23f6072e-1347-40e9-9c4a-41fecaed7135 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:53.881519 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-23f6072e-1347-40e9-9c4a-41fecaed7135 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07" status: 200 len: 1679 microversion: 2.1 time: 0.151812 Jul 31 14:27:53.882093 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 338/691] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:53 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:54.505423 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a87ff42e-626f-4a97-8e2f-5ca5332b939f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:54.505924 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a87ff42e-626f-4a97-8e2f-5ca5332b939f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:54.512479 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a87ff42e-626f-4a97-8e2f-5ca5332b939f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:54.512918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a87ff42e-626f-4a97-8e2f-5ca5332b939f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:54.513681 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a87ff42e-626f-4a97-8e2f-5ca5332b939f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:54.514152 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a87ff42e-626f-4a97-8e2f-5ca5332b939f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:54.584639 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-1bd4f138-3d16-4fae-aa61-639a52a7809e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:54.585257 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-1bd4f138-3d16-4fae-aa61-639a52a7809e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:54.591347 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1bd4f138-3d16-4fae-aa61-639a52a7809e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:54.591828 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1bd4f138-3d16-4fae-aa61-639a52a7809e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:54.592587 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1bd4f138-3d16-4fae-aa61-639a52a7809e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:54.593038 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1bd4f138-3d16-4fae-aa61-639a52a7809e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:54.593298 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-a87ff42e-626f-4a97-8e2f-5ca5332b939f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lazy-loading 'services' on Instance uuid 337cbeb6-512e-4bf5-bd53-cd837c00947e {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:27:54.669292 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a87ff42e-626f-4a97-8e2f-5ca5332b939f tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "DELETE /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e/os-volume_attachments/9674eddb-1c82-4c41-99cf-406a9ae8f33e" status: 202 len: 0 microversion: 2.1 time: 0.167556 Jul 31 14:27:54.669938 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 354/692] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Jul 31 14:27:54 2022] DELETE /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e/os-volume_attachments/9674eddb-1c82-4c41-99cf-406a9ae8f33e => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:27:54.678917 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8e90aabd-cb8b-4afa-bc78-1a4d7888773c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:54.681255 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8e90aabd-cb8b-4afa-bc78-1a4d7888773c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:54.687924 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8e90aabd-cb8b-4afa-bc78-1a4d7888773c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:54.688367 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8e90aabd-cb8b-4afa-bc78-1a4d7888773c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:54.689217 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8e90aabd-cb8b-4afa-bc78-1a4d7888773c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:54.689653 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8e90aabd-cb8b-4afa-bc78-1a4d7888773c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:54.721229 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8e90aabd-cb8b-4afa-bc78-1a4d7888773c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046849 Jul 31 14:27:54.722514 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 355/693] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Jul 31 14:27:54 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:27:54.809450 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-1bd4f138-3d16-4fae-aa61-639a52a7809e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:54.817058 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-1bd4f138-3d16-4fae-aa61-639a52a7809e tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1573 microversion: 2.1 time: 0.236270 Jul 31 14:27:54.817712 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 339/694] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:54 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1573 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:27:54.902636 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2d3165d3-6933-4016-9664-b4444d513a51 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:54.903252 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2d3165d3-6933-4016-9664-b4444d513a51 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:54.909892 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2d3165d3-6933-4016-9664-b4444d513a51 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:54.910390 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2d3165d3-6933-4016-9664-b4444d513a51 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:54.911185 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2d3165d3-6933-4016-9664-b4444d513a51 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:54.911652 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2d3165d3-6933-4016-9664-b4444d513a51 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:55.038991 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2d3165d3-6933-4016-9664-b4444d513a51 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:55.046485 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2d3165d3-6933-4016-9664-b4444d513a51 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07" status: 200 len: 1679 microversion: 2.1 time: 0.147763 Jul 31 14:27:55.047068 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 356/695] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:54 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:55.530112 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-6bfba8ee-5998-427b-bb67-e32d0dfc3e35 req-92ff53ab-72a6-4a27-8c87-2e9f7d175a18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b65263c9-40f6-48e3-9e44-b8654f688d07", "name": "network-vif-deleted", "tag": "7e5cce5a-1a99-4a5c-bf5a-9f385c9918bc"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:27:55.540358 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-6bfba8ee-5998-427b-bb67-e32d0dfc3e35 req-92ff53ab-72a6-4a27-8c87-2e9f7d175a18 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:55.540787 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-6bfba8ee-5998-427b-bb67-e32d0dfc3e35 req-92ff53ab-72a6-4a27-8c87-2e9f7d175a18 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:55.552512 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-6bfba8ee-5998-427b-bb67-e32d0dfc3e35 req-92ff53ab-72a6-4a27-8c87-2e9f7d175a18 service nova] Creating event network-vif-deleted:7e5cce5a-1a99-4a5c-bf5a-9f385c9918bc for instance b65263c9-40f6-48e3-9e44-b8654f688d07 on hv-cinder-84984 Jul 31 14:27:55.558593 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-6bfba8ee-5998-427b-bb67-e32d0dfc3e35 req-92ff53ab-72a6-4a27-8c87-2e9f7d175a18 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032016 Jul 31 14:27:55.562333 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 340/696] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:27:55.734152 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f0075c40-3866-44fd-8725-727c93db00a7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:55.736492 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f0075c40-3866-44fd-8725-727c93db00a7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:55.745031 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0075c40-3866-44fd-8725-727c93db00a7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:55.746417 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0075c40-3866-44fd-8725-727c93db00a7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:55.747232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0075c40-3866-44fd-8725-727c93db00a7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:55.747870 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0075c40-3866-44fd-8725-727c93db00a7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:55.780404 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f0075c40-3866-44fd-8725-727c93db00a7 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050914 Jul 31 14:27:55.781125 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 357/697] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Jul 31 14:27:55 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 14:27:55.847513 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-c196016e-f55e-432b-9056-a370e85d6f0b tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:55.847513 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-c196016e-f55e-432b-9056-a370e85d6f0b tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:55.847513 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c196016e-f55e-432b-9056-a370e85d6f0b tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:55.847513 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c196016e-f55e-432b-9056-a370e85d6f0b tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:55.848297 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c196016e-f55e-432b-9056-a370e85d6f0b tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:55.848977 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c196016e-f55e-432b-9056-a370e85d6f0b tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:55.857638 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-73f6dd72-8053-4c43-aa92-78f152f1999c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:55.858218 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-73f6dd72-8053-4c43-aa92-78f152f1999c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:55.864880 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-73f6dd72-8053-4c43-aa92-78f152f1999c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:55.865408 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-73f6dd72-8053-4c43-aa92-78f152f1999c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:55.866329 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-73f6dd72-8053-4c43-aa92-78f152f1999c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:55.866844 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-73f6dd72-8053-4c43-aa92-78f152f1999c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:55.893984 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-73f6dd72-8053-4c43-aa92-78f152f1999c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Going to try to terminate instance {{(pid=117780) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 14:27:55.932219 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:27:55.982549 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-73f6dd72-8053-4c43-aa92-78f152f1999c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "DELETE /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 204 len: 0 microversion: 2.1 time: 0.128368 Jul 31 14:27:55.986305 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 358/698] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:27:55 2022] DELETE /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 14:27:55.992655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-31c9f492-e171-4ef4-9769-05fb6a64ee13 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:55.993389 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-31c9f492-e171-4ef4-9769-05fb6a64ee13 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:55.999572 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-31c9f492-e171-4ef4-9769-05fb6a64ee13 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:56.000025 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-31c9f492-e171-4ef4-9769-05fb6a64ee13 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:56.000830 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-31c9f492-e171-4ef4-9769-05fb6a64ee13 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:56.001385 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-31c9f492-e171-4ef4-9769-05fb6a64ee13 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:56.002663 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c196016e-f55e-432b-9056-a370e85d6f0b tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:56.031335 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-c196016e-f55e-432b-9056-a370e85d6f0b tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1573 microversion: 2.1 time: 0.194124 Jul 31 14:27:56.031907 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 341/699] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:55 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1573 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:56.067825 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-8a9cc467-e5be-4ff6-8fbf-b4c741c00f5f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:56.068439 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-8a9cc467-e5be-4ff6-8fbf-b4c741c00f5f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:56.074960 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8a9cc467-e5be-4ff6-8fbf-b4c741c00f5f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:56.075697 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8a9cc467-e5be-4ff6-8fbf-b4c741c00f5f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:56.076484 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8a9cc467-e5be-4ff6-8fbf-b4c741c00f5f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:56.077101 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8a9cc467-e5be-4ff6-8fbf-b4c741c00f5f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:56.113508 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8a9cc467-e5be-4ff6-8fbf-b4c741c00f5f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:56.113953 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8a9cc467-e5be-4ff6-8fbf-b4c741c00f5f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:56.114408 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.objects.instance [None req-8a9cc467-e5be-4ff6-8fbf-b4c741c00f5f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lazy-loading 'fault' on Instance uuid b65263c9-40f6-48e3-9e44-b8654f688d07 {{(pid=117781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:27:56.149439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-31c9f492-e171-4ef4-9769-05fb6a64ee13 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:56.157232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-31c9f492-e171-4ef4-9769-05fb6a64ee13 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1690 microversion: 2.1 time: 0.169646 Jul 31 14:27:56.158143 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 359/700] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:55 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:56.177050 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-8a9cc467-e5be-4ff6-8fbf-b4c741c00f5f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:56.180932 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:27:56.185973 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-8a9cc467-e5be-4ff6-8fbf-b4c741c00f5f tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07" status: 200 len: 1329 microversion: 2.1 time: 0.122178 Jul 31 14:27:56.186548 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 342/701] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:56 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 => generated 1329 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:57.054385 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-128f2208-1f84-4036-83a1-abbfff893c56 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:57.055296 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-128f2208-1f84-4036-83a1-abbfff893c56 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:57.066185 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-128f2208-1f84-4036-83a1-abbfff893c56 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:57.066965 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-128f2208-1f84-4036-83a1-abbfff893c56 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:57.068353 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-128f2208-1f84-4036-83a1-abbfff893c56 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:57.069079 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-128f2208-1f84-4036-83a1-abbfff893c56 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:57.178738 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-68d639fb-961e-4948-9ce2-062446db77ad tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:57.179356 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-68d639fb-961e-4948-9ce2-062446db77ad tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:57.186523 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-68d639fb-961e-4948-9ce2-062446db77ad tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:57.186977 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-68d639fb-961e-4948-9ce2-062446db77ad tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:57.187783 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-68d639fb-961e-4948-9ce2-062446db77ad tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:57.188219 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-68d639fb-961e-4948-9ce2-062446db77ad tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:57.215741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-128f2208-1f84-4036-83a1-abbfff893c56 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:57.223317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-128f2208-1f84-4036-83a1-abbfff893c56 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1573 microversion: 2.1 time: 0.173798 Jul 31 14:27:57.223927 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 360/702] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:57 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1573 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:57.228348 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3d1d68b2-c08f-43ba-ac8a-6559e13e36da tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:57.228955 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3d1d68b2-c08f-43ba-ac8a-6559e13e36da tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:57.234800 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3d1d68b2-c08f-43ba-ac8a-6559e13e36da tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:57.235250 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3d1d68b2-c08f-43ba-ac8a-6559e13e36da tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:57.236179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3d1d68b2-c08f-43ba-ac8a-6559e13e36da tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:57.236625 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3d1d68b2-c08f-43ba-ac8a-6559e13e36da tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:57.268061 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3d1d68b2-c08f-43ba-ac8a-6559e13e36da tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:57.268508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3d1d68b2-c08f-43ba-ac8a-6559e13e36da tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:57.268958 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-3d1d68b2-c08f-43ba-ac8a-6559e13e36da tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lazy-loading 'fault' on Instance uuid b65263c9-40f6-48e3-9e44-b8654f688d07 {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:27:57.312190 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3d1d68b2-c08f-43ba-ac8a-6559e13e36da tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:57.320137 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-68d639fb-961e-4948-9ce2-062446db77ad tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:57.320875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3d1d68b2-c08f-43ba-ac8a-6559e13e36da tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07" status: 200 len: 1329 microversion: 2.1 time: 0.095788 Jul 31 14:27:57.321540 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 361/703] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:57 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 => generated 1329 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:57.328071 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-68d639fb-961e-4948-9ce2-062446db77ad tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1690 microversion: 2.1 time: 0.153942 Jul 31 14:27:57.328640 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 343/704] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:57 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:27:58.244374 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8303e0c0-5a81-44b7-99aa-53daba4fcc74 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:58.244983 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8303e0c0-5a81-44b7-99aa-53daba4fcc74 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:58.251512 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8303e0c0-5a81-44b7-99aa-53daba4fcc74 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:58.251964 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8303e0c0-5a81-44b7-99aa-53daba4fcc74 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:58.252752 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8303e0c0-5a81-44b7-99aa-53daba4fcc74 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:58.253185 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8303e0c0-5a81-44b7-99aa-53daba4fcc74 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:58.342132 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-94e0c61f-6cd2-4cb3-8ddf-b6aa79379608 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:58.342745 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-94e0c61f-6cd2-4cb3-8ddf-b6aa79379608 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:58.350096 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-94e0c61f-6cd2-4cb3-8ddf-b6aa79379608 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:58.350620 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-94e0c61f-6cd2-4cb3-8ddf-b6aa79379608 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:58.351398 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-94e0c61f-6cd2-4cb3-8ddf-b6aa79379608 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:58.351859 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-94e0c61f-6cd2-4cb3-8ddf-b6aa79379608 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:58.383775 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8303e0c0-5a81-44b7-99aa-53daba4fcc74 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:58.384812 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-94e0c61f-6cd2-4cb3-8ddf-b6aa79379608 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:58.385261 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-94e0c61f-6cd2-4cb3-8ddf-b6aa79379608 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:58.385719 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.objects.instance [None req-94e0c61f-6cd2-4cb3-8ddf-b6aa79379608 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lazy-loading 'fault' on Instance uuid b65263c9-40f6-48e3-9e44-b8654f688d07 {{(pid=117781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:27:58.391224 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8303e0c0-5a81-44b7-99aa-53daba4fcc74 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1573 microversion: 2.1 time: 0.150717 Jul 31 14:27:58.391842 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 362/705] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:58 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:58.396339 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d20e06fa-8e20-41f4-8a51-b7719ee771ad tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:58.396885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d20e06fa-8e20-41f4-8a51-b7719ee771ad tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:58.402681 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d20e06fa-8e20-41f4-8a51-b7719ee771ad tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:58.403132 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d20e06fa-8e20-41f4-8a51-b7719ee771ad tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:58.403939 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d20e06fa-8e20-41f4-8a51-b7719ee771ad tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:58.404379 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d20e06fa-8e20-41f4-8a51-b7719ee771ad tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:58.428707 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-94e0c61f-6cd2-4cb3-8ddf-b6aa79379608 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:58.437813 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-94e0c61f-6cd2-4cb3-8ddf-b6aa79379608 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07" status: 200 len: 1329 microversion: 2.1 time: 0.099482 Jul 31 14:27:58.438411 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 344/706] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:58 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 => generated 1329 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:27:58.545904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d20e06fa-8e20-41f4-8a51-b7719ee771ad tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:58.554106 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d20e06fa-8e20-41f4-8a51-b7719ee771ad tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1690 microversion: 2.1 time: 0.161320 Jul 31 14:27:58.554702 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 363/707] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:58 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:59.412594 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-6d625f3e-4ad2-4d13-a77c-37bac9e64971 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:59.413146 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-6d625f3e-4ad2-4d13-a77c-37bac9e64971 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:59.419655 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6d625f3e-4ad2-4d13-a77c-37bac9e64971 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:59.420116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6d625f3e-4ad2-4d13-a77c-37bac9e64971 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:59.420876 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6d625f3e-4ad2-4d13-a77c-37bac9e64971 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:59.421315 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6d625f3e-4ad2-4d13-a77c-37bac9e64971 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:59.460743 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a43deae4-e3ff-47fa-9eae-c20eb41f2e66 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:59.461333 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a43deae4-e3ff-47fa-9eae-c20eb41f2e66 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:59.469156 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a43deae4-e3ff-47fa-9eae-c20eb41f2e66 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:59.469726 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a43deae4-e3ff-47fa-9eae-c20eb41f2e66 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:59.470590 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a43deae4-e3ff-47fa-9eae-c20eb41f2e66 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:59.471176 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a43deae4-e3ff-47fa-9eae-c20eb41f2e66 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:59.484707 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-a43deae4-e3ff-47fa-9eae-c20eb41f2e66 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] HTTP exception thrown: Instance b65263c9-40f6-48e3-9e44-b8654f688d07 could not be found. Jul 31 14:27:59.486439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a43deae4-e3ff-47fa-9eae-c20eb41f2e66 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Request method failure captured: Jul 31 14:27:59.486439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 HTTP/1.1 Jul 31 14:27:59.486439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:27:59.486439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:27:59.486439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:27:59.486439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:27:59.486439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:27:59.486439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:27:59.486439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:27:59.486439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:27:59.486439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pA3RnV2a-dDWWL-_ZfxXcr4UktgQI-9SWPGN4xUIh3gpaTPpUlCMNWU1g96nJfR_a1KYUrPG43SkpeWWkH3LXQwcjtBN7d_0kQ02fiRqueKY6XZVQNh8gR0_ddCj_gKuHBtsN430P5RXgDqCVuPQ_rcT-N1y6dWBKzFpQGKjlxkqC0 Jul 31 14:27:59.486439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:27:59.486439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:27:59.486439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:27:59.486439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:27:59.486439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:27:59.486439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:27:59.486439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:27:59.486439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:27:59.486439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:27:59.486439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:27:59.488384 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9097fd66951e457ba46812ff17db7501", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9097fd66951e457ba46812ff17db7501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:27:59.488384 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:27:59.488384 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:27:59.488384 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:27:59.488384 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:27:59.488384 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:27:59.488384 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:27:59.488384 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: d6e8399080a942f1b689fc8c6b42c717 Jul 31 14:27:59.488384 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:27:59.488384 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:27:59.488384 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance b65263c9-40f6-48e3-9e44-b8654f688d07 could not be found. Jul 31 14:27:59.488384 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': 'b65263c9-40f6-48e3-9e44-b8654f688d07'} Jul 31 14:27:59.489111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:27:59.489111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:27:59.489111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:27:59.489111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:27:59.489111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:27:59.489111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:27:59.489111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:27:59.489111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:27:59.489111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:27:59.489111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:27:59.489111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b65263c9-40f6-48e3-9e44-b8654f688d07 could not be found. Jul 31 14:27:59.489111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:27:59.489111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:27:59.489111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:27:59.489111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:27:59.489111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:27:59.489111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:27:59.489111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:27:59.489111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:27:59.489111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:27:59.490533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:27:59.490533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:27:59.490533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:27:59.490533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:27:59.490533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:27:59.490533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:27:59.490533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:27:59.490533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b65263c9-40f6-48e3-9e44-b8654f688d07 could not be found. Jul 31 14:27:59.490533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:27:59.490533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:27:59.490533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:27:59.490533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:27:59.490533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:27:59.490533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:27:59.490533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:27:59.490533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:27:59.490533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b65263c9-40f6-48e3-9e44-b8654f688d07 could not be found. Jul 31 14:27:59.490533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:27:59.491979 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a43deae4-e3ff-47fa-9eae-c20eb41f2e66 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Returning 404 to user: Instance b65263c9-40f6-48e3-9e44-b8654f688d07 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:27:59.491979 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a43deae4-e3ff-47fa-9eae-c20eb41f2e66 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07" status: 404 len: 111 microversion: 2.1 time: 0.032118 Jul 31 14:27:59.491979 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 364/708] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:59 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 14:27:59.497321 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c7bc96b7-33e1-4d92-a779-ff3e9ba6f9d7 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '.version_select at 0x7f87e989e8b0>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:59.516908 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c7bc96b7-33e1-4d92-a779-ff3e9ba6f9d7 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010088422" status: 202 len: 0 microversion: 2.1 time: 0.023030 Jul 31 14:27:59.517496 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 365/709] 10.222.0.40 () {58 vars in 1221 bytes} [Sun Jul 31 14:27:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010088422 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 14:27:59.557452 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-6d625f3e-4ad2-4d13-a77c-37bac9e64971 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:59.565095 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-6d625f3e-4ad2-4d13-a77c-37bac9e64971 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1573 microversion: 2.1 time: 0.156307 Jul 31 14:27:59.566275 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 345/710] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:59 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:27:59.629659 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-085a5792-8a3c-4e83-9e51-647130b0643d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:27:59.630282 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-085a5792-8a3c-4e83-9e51-647130b0643d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:27:59.637137 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-085a5792-8a3c-4e83-9e51-647130b0643d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:59.637724 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-085a5792-8a3c-4e83-9e51-647130b0643d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:59.638484 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-085a5792-8a3c-4e83-9e51-647130b0643d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:27:59.638926 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-085a5792-8a3c-4e83-9e51-647130b0643d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:27:59.788573 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-085a5792-8a3c-4e83-9e51-647130b0643d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:27:59.796027 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-085a5792-8a3c-4e83-9e51-647130b0643d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1690 microversion: 2.1 time: 0.225595 Jul 31 14:27:59.796587 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 366/711] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:27:59 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1690 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:00.148268 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-60720fe8-08a4-4f13-a7a9-01681777258b tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Action: 'create', calling method: .version_select at 0x7f87e99d6ca0>, body: {"keypair": {"name": "tempest-keypair-1531124973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpFFcL3TGI5cg5hEUOfcxeH6WgDmyBj1wQkS7b3DUL28W/XmIllJgPrVQ7/tuChgzyKNeA7cU+3KiPlbofXZvUDwKdbTqoD2Y91beEBeN3xn7+Nl7nkFJBEmfyxW3ruJA=="}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:28:00.163255 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-60720fe8-08a4-4f13-a7a9-01681777258b tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Getting quotas for project 9097fd66951e457ba46812ff17db7501. Resources: {'key_pairs'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:28:00.167032 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-60720fe8-08a4-4f13-a7a9-01681777258b tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Getting quotas for user d6e8399080a942f1b689fc8c6b42c717 and project 9097fd66951e457ba46812ff17db7501. Resources: {'key_pairs'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:28:00.188257 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-60720fe8-08a4-4f13-a7a9-01681777258b tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043809 Jul 31 14:28:00.188770 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 346/712] 10.222.0.40 () {60 vars in 1159 bytes} [Sun Jul 31 14:28:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:28:00.587639 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5b61789e-2fdd-464d-a394-5ae7d74bbbd4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:00.588248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-5b61789e-2fdd-464d-a394-5ae7d74bbbd4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:00.594719 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5b61789e-2fdd-464d-a394-5ae7d74bbbd4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:00.595162 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5b61789e-2fdd-464d-a394-5ae7d74bbbd4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:00.595964 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5b61789e-2fdd-464d-a394-5ae7d74bbbd4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:00.596392 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5b61789e-2fdd-464d-a394-5ae7d74bbbd4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:00.783333 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-5b61789e-2fdd-464d-a394-5ae7d74bbbd4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:00.791020 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-5b61789e-2fdd-464d-a394-5ae7d74bbbd4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1573 microversion: 2.1 time: 0.207258 Jul 31 14:28:00.791801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 367/713] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:00 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1573 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:00.819523 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-3683164a-7ab1-4d65-8e1f-fba050c2b33c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:00.820267 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-3683164a-7ab1-4d65-8e1f-fba050c2b33c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:00.827223 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3683164a-7ab1-4d65-8e1f-fba050c2b33c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:00.827836 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3683164a-7ab1-4d65-8e1f-fba050c2b33c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:00.828863 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3683164a-7ab1-4d65-8e1f-fba050c2b33c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:00.829517 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3683164a-7ab1-4d65-8e1f-fba050c2b33c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:00.932253 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-3683164a-7ab1-4d65-8e1f-fba050c2b33c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:00.940780 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-3683164a-7ab1-4d65-8e1f-fba050c2b33c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1622 microversion: 2.1 time: 0.126704 Jul 31 14:28:00.941805 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 347/714] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:00 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1622 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:01.434900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-c1d0ce67-8ead-4543-aff9-bf60e92a3134 req-c58a1b20-ddb5-4a55-b3ef-789b7ebe7cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337cbeb6-512e-4bf5-bd53-cd837c00947e", "name": "network-vif-deleted", "tag": "8cbcf7d3-6045-42ae-b5a4-ef6ca863d210"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:28:01.444926 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-c1d0ce67-8ead-4543-aff9-bf60e92a3134 req-c58a1b20-ddb5-4a55-b3ef-789b7ebe7cf3 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:01.445307 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-c1d0ce67-8ead-4543-aff9-bf60e92a3134 req-c58a1b20-ddb5-4a55-b3ef-789b7ebe7cf3 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:01.456923 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-c1d0ce67-8ead-4543-aff9-bf60e92a3134 req-c58a1b20-ddb5-4a55-b3ef-789b7ebe7cf3 service nova] Creating event network-vif-deleted:8cbcf7d3-6045-42ae-b5a4-ef6ca863d210 for instance 337cbeb6-512e-4bf5-bd53-cd837c00947e on hv-cinder-84984 Jul 31 14:28:01.462382 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-c1d0ce67-8ead-4543-aff9-bf60e92a3134 req-c58a1b20-ddb5-4a55-b3ef-789b7ebe7cf3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031235 Jul 31 14:28:01.463636 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 368/715] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:28:01.705553 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-1768fe24-aa48-46fb-8829-f82b0bf2f098 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1586840433", "imageRef": "57bc051a-64d0-4317-aa93-a7a2aed39369", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cbc0073a-ae55-48a9-8514-9052086eccf8"}], "security_groups": [{"name": "tempest-securitygroup--1028101497"}], "key_name": "tempest-keypair-1531124973", "user_data": "}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:28:01.809142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.network.neutron [None req-1768fe24-aa48-46fb-8829-f82b0bf2f098 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] validate_networks() for [('cbc0073a-ae55-48a9-8514-9052086eccf8', None, None, None, None, None)] {{(pid=117781) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 14:28:01.814628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-42d565d8-440e-47ce-90f2-f8f1a8ecfd46 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:01.815708 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-42d565d8-440e-47ce-90f2-f8f1a8ecfd46 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:01.822287 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-42d565d8-440e-47ce-90f2-f8f1a8ecfd46 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:01.822876 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-42d565d8-440e-47ce-90f2-f8f1a8ecfd46 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:01.823791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-42d565d8-440e-47ce-90f2-f8f1a8ecfd46 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:01.824339 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-42d565d8-440e-47ce-90f2-f8f1a8ecfd46 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:01.975942 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-42d565d8-440e-47ce-90f2-f8f1a8ecfd46 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:01.991484 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-42d565d8-440e-47ce-90f2-f8f1a8ecfd46 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1573 microversion: 2.1 time: 0.181348 Jul 31 14:28:01.992197 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 369/716] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:01 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1573 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:28:02.013073 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a2097957-5d71-43b3-b51f-e8f50aa33b99 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:02.031161 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a2097957-5d71-43b3-b51f-e8f50aa33b99 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:02.036602 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:28:02.038658 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a2097957-5d71-43b3-b51f-e8f50aa33b99 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:02.039512 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a2097957-5d71-43b3-b51f-e8f50aa33b99 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:02.040462 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a2097957-5d71-43b3-b51f-e8f50aa33b99 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:02.041130 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a2097957-5d71-43b3-b51f-e8f50aa33b99 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:02.095008 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a2097957-5d71-43b3-b51f-e8f50aa33b99 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:02.095726 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a2097957-5d71-43b3-b51f-e8f50aa33b99 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:02.096362 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-a2097957-5d71-43b3-b51f-e8f50aa33b99 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lazy-loading 'fault' on Instance uuid 337cbeb6-512e-4bf5-bd53-cd837c00947e {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:28:02.151110 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a2097957-5d71-43b3-b51f-e8f50aa33b99 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:02.160352 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a2097957-5d71-43b3-b51f-e8f50aa33b99 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 200 len: 1336 microversion: 2.1 time: 0.166379 Jul 31 14:28:02.161702 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 370/717] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:01 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 1336 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:02.327772 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-1768fe24-aa48-46fb-8829-f82b0bf2f098 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Flavor limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 14:28:02.328277 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-1768fe24-aa48-46fb-8829-f82b0bf2f098 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Image limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 14:28:02.328867 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-1768fe24-aa48-46fb-8829-f82b0bf2f098 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Flavor pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 14:28:02.329348 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-1768fe24-aa48-46fb-8829-f82b0bf2f098 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Image pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 14:28:02.329833 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-1768fe24-aa48-46fb-8829-f82b0bf2f098 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 14:28:02.339656 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1768fe24-aa48-46fb-8829-f82b0bf2f098 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:02.340190 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1768fe24-aa48-46fb-8829-f82b0bf2f098 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:02.341177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1768fe24-aa48-46fb-8829-f82b0bf2f098 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:02.341622 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1768fe24-aa48-46fb-8829-f82b0bf2f098 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:02.358968 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-1768fe24-aa48-46fb-8829-f82b0bf2f098 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Getting quotas for project 9097fd66951e457ba46812ff17db7501. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:28:02.363722 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-1768fe24-aa48-46fb-8829-f82b0bf2f098 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Getting quotas for user d6e8399080a942f1b689fc8c6b42c717 and project 9097fd66951e457ba46812ff17db7501. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:28:02.375684 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-1768fe24-aa48-46fb-8829-f82b0bf2f098 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Going to run 1 instances... {{(pid=117781) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 14:28:02.378626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-1768fe24-aa48-46fb-8829-f82b0bf2f098 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57bc051a-64d0-4317-aa93-a7a2aed39369',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117781) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 14:28:02.426571 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-1768fe24-aa48-46fb-8829-f82b0bf2f098 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.725504 Jul 31 14:28:02.427219 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 348/718] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Jul 31 14:28:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 14:28:02.438186 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a16ad04d-2f80-4a63-9640-1ed601afc9f9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:02.438867 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a16ad04d-2f80-4a63-9640-1ed601afc9f9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:02.493710 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a16ad04d-2f80-4a63-9640-1ed601afc9f9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:02.501785 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a16ad04d-2f80-4a63-9640-1ed601afc9f9 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd" status: 200 len: 1242 microversion: 2.1 time: 0.067467 Jul 31 14:28:02.503661 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 371/719] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:02 2022] GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:03.017840 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b45909db-c7e5-414e-870e-62314815bcf3 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:03.018627 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b45909db-c7e5-414e-870e-62314815bcf3 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:03.025209 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b45909db-c7e5-414e-870e-62314815bcf3 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:03.025663 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b45909db-c7e5-414e-870e-62314815bcf3 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:03.026432 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b45909db-c7e5-414e-870e-62314815bcf3 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:03.026903 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b45909db-c7e5-414e-870e-62314815bcf3 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:03.172435 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b45909db-c7e5-414e-870e-62314815bcf3 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:03.181011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b45909db-c7e5-414e-870e-62314815bcf3 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1573 microversion: 2.1 time: 0.166626 Jul 31 14:28:03.181358 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-13c04fe1-9728-419a-9813-77ac24688103 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:03.181894 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 349/720] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:03 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:03.182060 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-13c04fe1-9728-419a-9813-77ac24688103 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 337cbeb6-512e-4bf5-bd53-cd837c00947e] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:03.188213 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-13c04fe1-9728-419a-9813-77ac24688103 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:03.188668 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-13c04fe1-9728-419a-9813-77ac24688103 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:03.189441 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-13c04fe1-9728-419a-9813-77ac24688103 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:03.189880 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-13c04fe1-9728-419a-9813-77ac24688103 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:03.204038 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-13c04fe1-9728-419a-9813-77ac24688103 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] HTTP exception thrown: Instance 337cbeb6-512e-4bf5-bd53-cd837c00947e could not be found. Jul 31 14:28:03.206623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-13c04fe1-9728-419a-9813-77ac24688103 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Request method failure captured: Jul 31 14:28:03.206623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e HTTP/1.1 Jul 31 14:28:03.206623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:28:03.206623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:28:03.206623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:28:03.206623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:28:03.206623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:28:03.206623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:28:03.206623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:28:03.206623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:28:03.206623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pBD72W1Rjv6at1WfVNUymNduY_N-nFbxGXJkrDc28rQU3JtMQkgCsFoz5JacBevK8YSVtt5PGEmj8VgqIeKUZCOYsB9PlAVGw4jymIy85OyVcpnTAbNXZcwZxntPYKfyuD8D6hHzBOe0TS_x7j6S_M-nQlq-6OQzOt_ElSF-AtfcFg Jul 31 14:28:03.206623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:28:03.206623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:28:03.206623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:28:03.206623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:28:03.206623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:28:03.206623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:28:03.206623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: 832629dd8594494ab41b6596b2d73076 Jul 31 14:28:03.206623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1831825154 Jul 31 14:28:03.206623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:28:03.206623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:28:03.207988 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/832629dd8594494ab41b6596b2d73076"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_832629dd8594494ab41b6596b2d73076", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/832629dd8594494ab41b6596b2d73076"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/832629dd8594494ab41b6596b2d73076"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:28:03.207988 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1831825154 Jul 31 14:28:03.207988 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 832629dd8594494ab41b6596b2d73076 Jul 31 14:28:03.207988 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1831825154 Jul 31 14:28:03.207988 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-ServerRescueNegativeTestJSON-1831825154-project Jul 31 14:28:03.207988 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:28:03.207988 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:28:03.207988 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: 10a4469c46f64feb819f3b19a0f4e89b Jul 31 14:28:03.207988 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1831825154-project Jul 31 14:28:03.207988 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:28:03.207988 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance 337cbeb6-512e-4bf5-bd53-cd837c00947e could not be found. Jul 31 14:28:03.207988 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': '337cbeb6-512e-4bf5-bd53-cd837c00947e'} Jul 31 14:28:03.208727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:28:03.208727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:28:03.208727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:28:03.208727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:28:03.208727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:28:03.208727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:28:03.208727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:28:03.208727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:28:03.208727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:28:03.208727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:28:03.208727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337cbeb6-512e-4bf5-bd53-cd837c00947e could not be found. Jul 31 14:28:03.208727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:28:03.208727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:28:03.208727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:28:03.208727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:28:03.208727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:28:03.208727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:28:03.208727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:28:03.208727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:28:03.208727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:28:03.209904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:28:03.209904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:28:03.209904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:28:03.209904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:28:03.209904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:28:03.209904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:28:03.209904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:28:03.209904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337cbeb6-512e-4bf5-bd53-cd837c00947e could not be found. Jul 31 14:28:03.209904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:28:03.209904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:28:03.209904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:28:03.209904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:28:03.209904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:28:03.209904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:28:03.209904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:28:03.209904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:28:03.209904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337cbeb6-512e-4bf5-bd53-cd837c00947e could not be found. Jul 31 14:28:03.209904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:28:03.211114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-13c04fe1-9728-419a-9813-77ac24688103 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Returning 404 to user: Instance 337cbeb6-512e-4bf5-bd53-cd837c00947e could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:28:03.211114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-13c04fe1-9728-419a-9813-77ac24688103 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e" status: 404 len: 111 microversion: 2.1 time: 0.031189 Jul 31 14:28:03.211114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 372/721] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:03 2022] GET /compute/v2.1/servers/337cbeb6-512e-4bf5-bd53-cd837c00947e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 14:28:03.217790 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-62ba9481-5450-4c83-9ccb-9b1c9554c59c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '.version_select at 0x7f87e9a341f0>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:03.237663 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-62ba9481-5450-4c83-9ccb-9b1c9554c59c tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1769865524" status: 202 len: 0 microversion: 2.1 time: 0.024382 Jul 31 14:28:03.238222 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 350/722] 10.222.0.40 () {58 vars in 1221 bytes} [Sun Jul 31 14:28:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1769865524 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:28:03.524228 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fd026b11-b12b-476f-a419-1b8fd2e1aef1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:03.524838 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fd026b11-b12b-476f-a419-1b8fd2e1aef1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:03.531118 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd026b11-b12b-476f-a419-1b8fd2e1aef1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:03.531604 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd026b11-b12b-476f-a419-1b8fd2e1aef1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:03.532369 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd026b11-b12b-476f-a419-1b8fd2e1aef1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:03.532800 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd026b11-b12b-476f-a419-1b8fd2e1aef1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:03.599881 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fd026b11-b12b-476f-a419-1b8fd2e1aef1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:03.608648 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fd026b11-b12b-476f-a419-1b8fd2e1aef1 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd" status: 200 len: 1294 microversion: 2.1 time: 0.087694 Jul 31 14:28:03.609231 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 373/723] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:03 2022] GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:04.146781 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-36464b74-935d-4989-8d1a-521354ec44e0 req-1b3f951d-d594-4a7e-92ec-737f0397ac03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92439dcd-76b3-44fb-882b-1b8f0dcb9d73", "name": "network-vif-plugged", "status": "completed", "tag": "e91303da-f1e0-49da-acae-3ce6750984f8"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:28:04.177920 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-36464b74-935d-4989-8d1a-521354ec44e0 req-1b3f951d-d594-4a7e-92ec-737f0397ac03 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:04.178666 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-36464b74-935d-4989-8d1a-521354ec44e0 req-1b3f951d-d594-4a7e-92ec-737f0397ac03 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:04.191998 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-36464b74-935d-4989-8d1a-521354ec44e0 req-1b3f951d-d594-4a7e-92ec-737f0397ac03 service nova] Creating event network-vif-plugged:e91303da-f1e0-49da-acae-3ce6750984f8 for instance 92439dcd-76b3-44fb-882b-1b8f0dcb9d73 on hv-cinder-84984 Jul 31 14:28:04.199292 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-36464b74-935d-4989-8d1a-521354ec44e0 req-1b3f951d-d594-4a7e-92ec-737f0397ac03 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062874 Jul 31 14:28:04.200710 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 351/724] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:28:04.206119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1fec4594-7e97-48fa-93d4-f5288357a069 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:04.206831 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1fec4594-7e97-48fa-93d4-f5288357a069 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:04.213653 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1fec4594-7e97-48fa-93d4-f5288357a069 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:04.214335 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1fec4594-7e97-48fa-93d4-f5288357a069 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:04.215195 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1fec4594-7e97-48fa-93d4-f5288357a069 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:04.215785 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1fec4594-7e97-48fa-93d4-f5288357a069 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:04.359670 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1fec4594-7e97-48fa-93d4-f5288357a069 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:04.369656 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1fec4594-7e97-48fa-93d4-f5288357a069 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1573 microversion: 2.1 time: 0.170023 Jul 31 14:28:04.370331 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 374/725] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:04 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:04.630432 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-2990c408-98f6-49dc-a0e9-71a43bdb7c45 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:04.631134 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-2990c408-98f6-49dc-a0e9-71a43bdb7c45 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:04.637617 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2990c408-98f6-49dc-a0e9-71a43bdb7c45 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:04.638065 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2990c408-98f6-49dc-a0e9-71a43bdb7c45 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:04.638841 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2990c408-98f6-49dc-a0e9-71a43bdb7c45 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:04.639276 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2990c408-98f6-49dc-a0e9-71a43bdb7c45 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:04.769024 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-2990c408-98f6-49dc-a0e9-71a43bdb7c45 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:04.776463 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-2990c408-98f6-49dc-a0e9-71a43bdb7c45 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd" status: 200 len: 1368 microversion: 2.1 time: 0.150283 Jul 31 14:28:04.777118 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 352/726] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:04 2022] GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:28:05.390150 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9d39b38c-d981-421a-9aae-b7a0bd83f079 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:05.390799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9d39b38c-d981-421a-9aae-b7a0bd83f079 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:05.398262 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9d39b38c-d981-421a-9aae-b7a0bd83f079 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:05.398719 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9d39b38c-d981-421a-9aae-b7a0bd83f079 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:05.399720 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9d39b38c-d981-421a-9aae-b7a0bd83f079 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:05.401135 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9d39b38c-d981-421a-9aae-b7a0bd83f079 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:05.476242 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-68e79839-3f88-4eb0-a804-3e1b7e27d5cf req-70315da9-af56-404b-be08-42d147fe53d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d6930f-fac2-4f58-996e-00224187cbbd", "tag": "cceca3ff-4dba-468b-9a2c-92275cf1a02c"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:28:05.493380 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-68e79839-3f88-4eb0-a804-3e1b7e27d5cf req-70315da9-af56-404b-be08-42d147fe53d3 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:05.493829 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-68e79839-3f88-4eb0-a804-3e1b7e27d5cf req-70315da9-af56-404b-be08-42d147fe53d3 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:05.508104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-68e79839-3f88-4eb0-a804-3e1b7e27d5cf req-70315da9-af56-404b-be08-42d147fe53d3 service nova] Creating event network-changed:cceca3ff-4dba-468b-9a2c-92275cf1a02c for instance 52d6930f-fac2-4f58-996e-00224187cbbd on hv-cinder-84984 Jul 31 14:28:05.514416 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-68e79839-3f88-4eb0-a804-3e1b7e27d5cf req-70315da9-af56-404b-be08-42d147fe53d3 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041663 Jul 31 14:28:05.515553 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 353/727] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:28:05.542978 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9d39b38c-d981-421a-9aae-b7a0bd83f079 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:05.551023 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9d39b38c-d981-421a-9aae-b7a0bd83f079 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1573 microversion: 2.1 time: 0.164855 Jul 31 14:28:05.551608 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 375/728] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:05 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:05.802236 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-788043de-3ae3-4f3d-9645-05be0634128d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:05.802959 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-788043de-3ae3-4f3d-9645-05be0634128d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:05.809196 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-788043de-3ae3-4f3d-9645-05be0634128d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:05.809647 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-788043de-3ae3-4f3d-9645-05be0634128d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:05.810403 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-788043de-3ae3-4f3d-9645-05be0634128d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:05.810842 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-788043de-3ae3-4f3d-9645-05be0634128d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:05.942440 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-788043de-3ae3-4f3d-9645-05be0634128d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:05.950772 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-788043de-3ae3-4f3d-9645-05be0634128d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd" status: 200 len: 1368 microversion: 2.1 time: 0.153277 Jul 31 14:28:05.951350 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 354/729] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:05 2022] GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:06.337616 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7444f950-2627-4297-82a1-ca1eef17508e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:06.338139 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7444f950-2627-4297-82a1-ca1eef17508e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:06.344113 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7444f950-2627-4297-82a1-ca1eef17508e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:06.344558 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7444f950-2627-4297-82a1-ca1eef17508e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:06.345309 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7444f950-2627-4297-82a1-ca1eef17508e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:06.345738 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7444f950-2627-4297-82a1-ca1eef17508e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:06.370499 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7444f950-2627-4297-82a1-ca1eef17508e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Going to try to terminate instance {{(pid=117780) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 14:28:06.404142 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:28:06.451572 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7444f950-2627-4297-82a1-ca1eef17508e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 204 len: 0 microversion: 2.1 time: 0.117450 Jul 31 14:28:06.455268 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 376/730] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:28:06 2022] DELETE /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 14:28:06.461098 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-963426ab-7fff-48bb-bf25-11c0e50d87fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:06.462142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-963426ab-7fff-48bb-bf25-11c0e50d87fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:06.468244 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-963426ab-7fff-48bb-bf25-11c0e50d87fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:06.468773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-963426ab-7fff-48bb-bf25-11c0e50d87fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:06.469610 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-963426ab-7fff-48bb-bf25-11c0e50d87fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:06.470123 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-963426ab-7fff-48bb-bf25-11c0e50d87fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:06.572526 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0788e67e-4409-4d2d-8ee4-7e934ad596c3 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:06.573231 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0788e67e-4409-4d2d-8ee4-7e934ad596c3 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:06.579870 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0788e67e-4409-4d2d-8ee4-7e934ad596c3 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:06.580317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0788e67e-4409-4d2d-8ee4-7e934ad596c3 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:06.581871 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0788e67e-4409-4d2d-8ee4-7e934ad596c3 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:06.582311 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0788e67e-4409-4d2d-8ee4-7e934ad596c3 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:06.610503 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-963426ab-7fff-48bb-bf25-11c0e50d87fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:06.618141 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-963426ab-7fff-48bb-bf25-11c0e50d87fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1507 microversion: 2.1 time: 0.160881 Jul 31 14:28:06.618809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 355/731] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:06 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:28:06.714303 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0788e67e-4409-4d2d-8ee4-7e934ad596c3 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:06.721762 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0788e67e-4409-4d2d-8ee4-7e934ad596c3 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1560 microversion: 2.1 time: 0.153398 Jul 31 14:28:06.722332 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 377/732] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:06 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:28:06.971407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-3bbb7da9-b5f1-4a8d-b52a-03edb3ccb347 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:06.971972 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-3bbb7da9-b5f1-4a8d-b52a-03edb3ccb347 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:06.977895 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3bbb7da9-b5f1-4a8d-b52a-03edb3ccb347 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:06.978342 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3bbb7da9-b5f1-4a8d-b52a-03edb3ccb347 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:06.979101 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3bbb7da9-b5f1-4a8d-b52a-03edb3ccb347 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:06.979570 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3bbb7da9-b5f1-4a8d-b52a-03edb3ccb347 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:07.109640 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-3bbb7da9-b5f1-4a8d-b52a-03edb3ccb347 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:07.118924 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-3bbb7da9-b5f1-4a8d-b52a-03edb3ccb347 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd" status: 200 len: 1368 microversion: 2.1 time: 0.151141 Jul 31 14:28:07.119871 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 356/733] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:06 2022] GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:07.639577 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9348a7d7-766d-45b6-8e79-4c5cad876ef8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:07.640163 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9348a7d7-766d-45b6-8e79-4c5cad876ef8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:07.647136 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9348a7d7-766d-45b6-8e79-4c5cad876ef8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:07.647613 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9348a7d7-766d-45b6-8e79-4c5cad876ef8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:07.648386 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9348a7d7-766d-45b6-8e79-4c5cad876ef8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:07.648816 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9348a7d7-766d-45b6-8e79-4c5cad876ef8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:07.780401 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9348a7d7-766d-45b6-8e79-4c5cad876ef8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:07.788576 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9348a7d7-766d-45b6-8e79-4c5cad876ef8 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1507 microversion: 2.1 time: 0.152797 Jul 31 14:28:07.789152 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 378/734] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:07 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:08.140750 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-ee3c0c57-9901-403e-9e32-c1e364b67de8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:08.141366 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-ee3c0c57-9901-403e-9e32-c1e364b67de8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:08.148529 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ee3c0c57-9901-403e-9e32-c1e364b67de8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:08.148983 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ee3c0c57-9901-403e-9e32-c1e364b67de8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:08.149809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ee3c0c57-9901-403e-9e32-c1e364b67de8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:08.150196 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ee3c0c57-9901-403e-9e32-c1e364b67de8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:08.275616 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-ee3c0c57-9901-403e-9e32-c1e364b67de8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:08.283012 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-ee3c0c57-9901-403e-9e32-c1e364b67de8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd" status: 200 len: 1368 microversion: 2.1 time: 0.146149 Jul 31 14:28:08.283614 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 357/735] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:08 2022] GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:08.809282 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-39f6c057-33f1-4576-9ee3-b70004868505 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:08.809918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-39f6c057-33f1-4576-9ee3-b70004868505 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:08.817040 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-39f6c057-33f1-4576-9ee3-b70004868505 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:08.817492 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-39f6c057-33f1-4576-9ee3-b70004868505 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:08.818306 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-39f6c057-33f1-4576-9ee3-b70004868505 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:08.818730 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-39f6c057-33f1-4576-9ee3-b70004868505 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:08.950570 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-39f6c057-33f1-4576-9ee3-b70004868505 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:08.957988 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-39f6c057-33f1-4576-9ee3-b70004868505 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1507 microversion: 2.1 time: 0.152608 Jul 31 14:28:08.958561 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 379/736] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:08 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:09.303143 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-ebb5def5-e070-466e-a377-945dfcf31499 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:09.303785 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-ebb5def5-e070-466e-a377-945dfcf31499 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:09.310241 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ebb5def5-e070-466e-a377-945dfcf31499 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:09.310693 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ebb5def5-e070-466e-a377-945dfcf31499 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:09.311481 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ebb5def5-e070-466e-a377-945dfcf31499 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:09.311922 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ebb5def5-e070-466e-a377-945dfcf31499 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:09.437389 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-ebb5def5-e070-466e-a377-945dfcf31499 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:09.444744 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-ebb5def5-e070-466e-a377-945dfcf31499 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd" status: 200 len: 1368 microversion: 2.1 time: 0.145444 Jul 31 14:28:09.445309 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 358/737] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:09 2022] GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:09.978692 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-81f8f59d-7c6f-4b1e-8d35-9e1e1b65e67e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:09.979446 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-81f8f59d-7c6f-4b1e-8d35-9e1e1b65e67e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:09.986356 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-81f8f59d-7c6f-4b1e-8d35-9e1e1b65e67e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:09.987295 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-81f8f59d-7c6f-4b1e-8d35-9e1e1b65e67e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:09.988117 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-81f8f59d-7c6f-4b1e-8d35-9e1e1b65e67e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:09.988556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-81f8f59d-7c6f-4b1e-8d35-9e1e1b65e67e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:10.117839 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-81f8f59d-7c6f-4b1e-8d35-9e1e1b65e67e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:10.131961 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-81f8f59d-7c6f-4b1e-8d35-9e1e1b65e67e tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1507 microversion: 2.1 time: 0.157135 Jul 31 14:28:10.144960 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 380/738] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:09 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:10.466383 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-0294225e-7314-48af-a9b2-2842b8150554 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:10.466998 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-0294225e-7314-48af-a9b2-2842b8150554 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:10.474171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0294225e-7314-48af-a9b2-2842b8150554 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:10.474620 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0294225e-7314-48af-a9b2-2842b8150554 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:10.475430 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0294225e-7314-48af-a9b2-2842b8150554 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:10.475875 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0294225e-7314-48af-a9b2-2842b8150554 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:10.795045 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-5e0175b1-d746-48f2-9772-f33be34dc2cf req-c73a6cb5-02aa-41a2-9ad5-4d658f44bed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b525f36f-61be-4205-85c9-112378b82b28", "name": "network-vif-deleted", "tag": "ed70b0fd-9fe3-4da7-820f-d863fbfcf92e"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:28:10.796150 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-0294225e-7314-48af-a9b2-2842b8150554 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:10.806291 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-5e0175b1-d746-48f2-9772-f33be34dc2cf req-c73a6cb5-02aa-41a2-9ad5-4d658f44bed2 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:10.807094 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-5e0175b1-d746-48f2-9772-f33be34dc2cf req-c73a6cb5-02aa-41a2-9ad5-4d658f44bed2 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:10.813116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-0294225e-7314-48af-a9b2-2842b8150554 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd" status: 200 len: 1368 microversion: 2.1 time: 0.350365 Jul 31 14:28:10.822373 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-5e0175b1-d746-48f2-9772-f33be34dc2cf req-c73a6cb5-02aa-41a2-9ad5-4d658f44bed2 service nova] Creating event network-vif-deleted:ed70b0fd-9fe3-4da7-820f-d863fbfcf92e for instance b525f36f-61be-4205-85c9-112378b82b28 on hv-cinder-84984 Jul 31 14:28:10.827024 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 359/739] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:10 2022] GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd => generated 1368 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:10.837357 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-5e0175b1-d746-48f2-9772-f33be34dc2cf req-c73a6cb5-02aa-41a2-9ad5-4d658f44bed2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046125 Jul 31 14:28:10.837945 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 381/740] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:28:11.155234 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7e904671-edc0-4286-bc27-f68b122169b5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:11.155945 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7e904671-edc0-4286-bc27-f68b122169b5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:11.162312 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7e904671-edc0-4286-bc27-f68b122169b5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:11.162708 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7e904671-edc0-4286-bc27-f68b122169b5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:11.163508 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7e904671-edc0-4286-bc27-f68b122169b5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:11.163965 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7e904671-edc0-4286-bc27-f68b122169b5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:11.194410 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7e904671-edc0-4286-bc27-f68b122169b5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:11.194857 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7e904671-edc0-4286-bc27-f68b122169b5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:11.195304 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.objects.instance [None req-7e904671-edc0-4286-bc27-f68b122169b5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lazy-loading 'fault' on Instance uuid b525f36f-61be-4205-85c9-112378b82b28 {{(pid=117781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:28:11.236611 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7e904671-edc0-4286-bc27-f68b122169b5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:11.243938 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7e904671-edc0-4286-bc27-f68b122169b5 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 200 len: 1312 microversion: 2.1 time: 0.092588 Jul 31 14:28:11.244509 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 360/741] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:11 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:11.474461 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8279cf23-47d2-4111-b290-b66a251eb272 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:11.475045 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8279cf23-47d2-4111-b290-b66a251eb272 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:11.481332 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8279cf23-47d2-4111-b290-b66a251eb272 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:11.481787 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8279cf23-47d2-4111-b290-b66a251eb272 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:11.482556 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8279cf23-47d2-4111-b290-b66a251eb272 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:11.482994 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8279cf23-47d2-4111-b290-b66a251eb272 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:11.506564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8279cf23-47d2-4111-b290-b66a251eb272 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc/ips" status: 200 len: 152 microversion: 2.20 time: 0.088541 Jul 31 14:28:11.507058 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 382/742] 10.222.0.40 () {60 vars in 1289 bytes} [Sun Jul 31 14:28:11 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc/ips => generated 152 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 14:28:11.834015 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-146a3d4c-1f27-4509-97ae-24b8dceb9de0 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:11.834622 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-146a3d4c-1f27-4509-97ae-24b8dceb9de0 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:11.837030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:28:11.842650 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-146a3d4c-1f27-4509-97ae-24b8dceb9de0 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:11.843089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-146a3d4c-1f27-4509-97ae-24b8dceb9de0 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:11.843887 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-146a3d4c-1f27-4509-97ae-24b8dceb9de0 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:11.844319 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-146a3d4c-1f27-4509-97ae-24b8dceb9de0 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:11.973206 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-146a3d4c-1f27-4509-97ae-24b8dceb9de0 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:11.980534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-146a3d4c-1f27-4509-97ae-24b8dceb9de0 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd" status: 200 len: 1368 microversion: 2.1 time: 0.150460 Jul 31 14:28:11.981111 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 361/743] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:11 2022] GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:12.265243 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9d822d4e-cd89-456e-adbe-e811c8267270 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:12.265858 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9d822d4e-cd89-456e-adbe-e811c8267270 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: b525f36f-61be-4205-85c9-112378b82b28] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:12.272452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9d822d4e-cd89-456e-adbe-e811c8267270 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:12.273260 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9d822d4e-cd89-456e-adbe-e811c8267270 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:12.274249 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9d822d4e-cd89-456e-adbe-e811c8267270 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:12.274689 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9d822d4e-cd89-456e-adbe-e811c8267270 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:12.288389 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-9d822d4e-cd89-456e-adbe-e811c8267270 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] HTTP exception thrown: Instance b525f36f-61be-4205-85c9-112378b82b28 could not be found. Jul 31 14:28:12.290012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9d822d4e-cd89-456e-adbe-e811c8267270 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Request method failure captured: Jul 31 14:28:12.290012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 HTTP/1.1 Jul 31 14:28:12.290012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:28:12.290012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:28:12.290012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:28:12.290012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:28:12.290012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:28:12.290012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:28:12.290012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:28:12.290012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:28:12.290012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pBD72W1Rjv6at1WfVNUymNduY_N-nFbxGXJkrDc28rQU3JtMQkgCsFoz5JacBevK8YSVtt5PGEmj8VgqIeKUZCOYsB9PlAVGw4jymIy85OyVcpnTAbNXZcwZxntPYKfyuD8D6hHzBOe0TS_x7j6S_M-nQlq-6OQzOt_ElSF-AtfcFg Jul 31 14:28:12.290012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:28:12.290012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:28:12.290012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:28:12.290012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:28:12.290012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:28:12.290012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:28:12.290012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: 832629dd8594494ab41b6596b2d73076 Jul 31 14:28:12.290012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1831825154 Jul 31 14:28:12.290012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:28:12.290012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:28:12.291600 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/832629dd8594494ab41b6596b2d73076"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_832629dd8594494ab41b6596b2d73076", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/832629dd8594494ab41b6596b2d73076"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/832629dd8594494ab41b6596b2d73076"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:28:12.291600 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1831825154 Jul 31 14:28:12.291600 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 832629dd8594494ab41b6596b2d73076 Jul 31 14:28:12.291600 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1831825154 Jul 31 14:28:12.291600 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-ServerRescueNegativeTestJSON-1831825154-project Jul 31 14:28:12.291600 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:28:12.291600 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:28:12.291600 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: 10a4469c46f64feb819f3b19a0f4e89b Jul 31 14:28:12.291600 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1831825154-project Jul 31 14:28:12.291600 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:28:12.291600 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance b525f36f-61be-4205-85c9-112378b82b28 could not be found. Jul 31 14:28:12.291600 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': 'b525f36f-61be-4205-85c9-112378b82b28'} Jul 31 14:28:12.292491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:28:12.292491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:28:12.292491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:28:12.292491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:28:12.292491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:28:12.292491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:28:12.292491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:28:12.292491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:28:12.292491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:28:12.292491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:28:12.292491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b525f36f-61be-4205-85c9-112378b82b28 could not be found. Jul 31 14:28:12.292491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:28:12.292491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:28:12.292491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:28:12.292491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:28:12.292491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:28:12.292491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:28:12.292491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:28:12.292491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:28:12.292491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:28:12.294017 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:28:12.294017 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:28:12.294017 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:28:12.294017 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:28:12.294017 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:28:12.294017 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:28:12.294017 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:28:12.294017 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b525f36f-61be-4205-85c9-112378b82b28 could not be found. Jul 31 14:28:12.294017 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:28:12.294017 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:28:12.294017 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:28:12.294017 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:28:12.294017 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:28:12.294017 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:28:12.294017 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:28:12.294017 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:28:12.294017 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b525f36f-61be-4205-85c9-112378b82b28 could not be found. Jul 31 14:28:12.294017 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:28:12.295357 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9d822d4e-cd89-456e-adbe-e811c8267270 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Returning 404 to user: Instance b525f36f-61be-4205-85c9-112378b82b28 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:28:12.295357 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9d822d4e-cd89-456e-adbe-e811c8267270 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28" status: 404 len: 111 microversion: 2.1 time: 0.030082 Jul 31 14:28:12.295357 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 383/744] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:12 2022] GET /compute/v2.1/servers/b525f36f-61be-4205-85c9-112378b82b28 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:28:12.300608 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b8453b1d-8f26-4a5c-bb2c-2534d150c1fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:12.301105 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b8453b1d-8f26-4a5c-bb2c-2534d150c1fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:12.306942 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b8453b1d-8f26-4a5c-bb2c-2534d150c1fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:12.307379 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b8453b1d-8f26-4a5c-bb2c-2534d150c1fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:12.308160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b8453b1d-8f26-4a5c-bb2c-2534d150c1fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:12.308590 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b8453b1d-8f26-4a5c-bb2c-2534d150c1fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:12.333110 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b8453b1d-8f26-4a5c-bb2c-2534d150c1fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Going to try to terminate instance {{(pid=117781) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 14:28:12.335820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=100 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:28:12.357077 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:28:12.370945 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=10 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:28:12.408044 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b8453b1d-8f26-4a5c-bb2c-2534d150c1fd tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "DELETE /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 204 len: 0 microversion: 2.1 time: 0.110883 Jul 31 14:28:12.409642 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 362/745] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:28:12 2022] DELETE /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 14:28:12.417312 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f52b5168-bd33-4d21-81d4-a056d6f853df tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:12.417979 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f52b5168-bd33-4d21-81d4-a056d6f853df tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:12.424377 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f52b5168-bd33-4d21-81d4-a056d6f853df tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:12.424826 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f52b5168-bd33-4d21-81d4-a056d6f853df tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:12.425581 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f52b5168-bd33-4d21-81d4-a056d6f853df tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:12.426014 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f52b5168-bd33-4d21-81d4-a056d6f853df tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:12.498629 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:28:12.572674 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f52b5168-bd33-4d21-81d4-a056d6f853df tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:12.580991 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f52b5168-bd33-4d21-81d4-a056d6f853df tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.167027 Jul 31 14:28:12.581562 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 384/746] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:12 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:28:13.002690 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-53f17bf5-d7e1-4204-99ce-489d6179dcde tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:13.003402 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-53f17bf5-d7e1-4204-99ce-489d6179dcde tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:13.009854 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-53f17bf5-d7e1-4204-99ce-489d6179dcde tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:13.010294 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-53f17bf5-d7e1-4204-99ce-489d6179dcde tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:13.011044 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-53f17bf5-d7e1-4204-99ce-489d6179dcde tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:13.011495 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-53f17bf5-d7e1-4204-99ce-489d6179dcde tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:13.141273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-53f17bf5-d7e1-4204-99ce-489d6179dcde tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:13.149280 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-53f17bf5-d7e1-4204-99ce-489d6179dcde tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd" status: 200 len: 1368 microversion: 2.1 time: 0.151204 Jul 31 14:28:13.149863 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 363/747] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:12 2022] GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:13.602391 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-bc829ae2-9d6d-4d96-8615-43847572bd67 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:13.603006 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-bc829ae2-9d6d-4d96-8615-43847572bd67 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:13.609646 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bc829ae2-9d6d-4d96-8615-43847572bd67 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:13.610091 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bc829ae2-9d6d-4d96-8615-43847572bd67 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:13.610853 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bc829ae2-9d6d-4d96-8615-43847572bd67 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:13.611289 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-bc829ae2-9d6d-4d96-8615-43847572bd67 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:13.745869 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-bc829ae2-9d6d-4d96-8615-43847572bd67 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:13.753323 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-bc829ae2-9d6d-4d96-8615-43847572bd67 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.155403 Jul 31 14:28:13.754584 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 385/748] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:13 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:13.843673 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-5e893040-67fe-4079-b4d0-865ea0869f1a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:28:13.844211 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-5e893040-67fe-4079-b4d0-865ea0869f1a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:13.850265 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5e893040-67fe-4079-b4d0-865ea0869f1a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:13.850715 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5e893040-67fe-4079-b4d0-865ea0869f1a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:13.851507 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5e893040-67fe-4079-b4d0-865ea0869f1a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:13.851952 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5e893040-67fe-4079-b4d0-865ea0869f1a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:13.876937 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.objects.instance [None req-5e893040-67fe-4079-b4d0-865ea0869f1a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lazy-loading 'flavor' on Instance uuid 6200d587-a817-4a77-b242-ec578e8e57dc {{(pid=117781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:28:14.056497 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-5e893040-67fe-4079-b4d0-865ea0869f1a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "POST /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc/action" status: 202 len: 0 microversion: 2.20 time: 0.216444 Jul 31 14:28:14.057367 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 364/749] 10.222.0.40 () {62 vars in 1319 bytes} [Sun Jul 31 14:28:13 2022] POST /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 14:28:14.065722 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9ac33a83-0212-4304-a516-813eb3c87924 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:14.066428 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9ac33a83-0212-4304-a516-813eb3c87924 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:14.072441 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9ac33a83-0212-4304-a516-813eb3c87924 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:14.072954 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9ac33a83-0212-4304-a516-813eb3c87924 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:14.073772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9ac33a83-0212-4304-a516-813eb3c87924 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:14.074275 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9ac33a83-0212-4304-a516-813eb3c87924 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:14.171121 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7a2c118a-bcbc-400e-9d91-efd4a91364f8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:14.171865 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7a2c118a-bcbc-400e-9d91-efd4a91364f8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:14.179764 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7a2c118a-bcbc-400e-9d91-efd4a91364f8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:14.180476 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7a2c118a-bcbc-400e-9d91-efd4a91364f8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:14.181700 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7a2c118a-bcbc-400e-9d91-efd4a91364f8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:14.182330 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7a2c118a-bcbc-400e-9d91-efd4a91364f8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:14.210885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9ac33a83-0212-4304-a516-813eb3c87924 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:14.220497 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9ac33a83-0212-4304-a516-813eb3c87924 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:14.222919 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9ac33a83-0212-4304-a516-813eb3c87924 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:14.224399 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9ac33a83-0212-4304-a516-813eb3c87924 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1725 microversion: 2.20 time: 0.162591 Jul 31 14:28:14.225597 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 386/750] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:14 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:14.230428 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-c5904315-ef78-422e-9808-442fb2292f89 req-b9fff9e8-8116-4580-b81b-2f3e472fe87d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d6930f-fac2-4f58-996e-00224187cbbd", "name": "network-vif-plugged", "status": "completed", "tag": "cceca3ff-4dba-468b-9a2c-92275cf1a02c"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:28:14.240995 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-c5904315-ef78-422e-9808-442fb2292f89 req-b9fff9e8-8116-4580-b81b-2f3e472fe87d service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:14.241852 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-c5904315-ef78-422e-9808-442fb2292f89 req-b9fff9e8-8116-4580-b81b-2f3e472fe87d service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:14.253700 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-c5904315-ef78-422e-9808-442fb2292f89 req-b9fff9e8-8116-4580-b81b-2f3e472fe87d service nova] Creating event network-vif-plugged:cceca3ff-4dba-468b-9a2c-92275cf1a02c for instance 52d6930f-fac2-4f58-996e-00224187cbbd on hv-cinder-84984 Jul 31 14:28:14.259165 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-c5904315-ef78-422e-9808-442fb2292f89 req-b9fff9e8-8116-4580-b81b-2f3e472fe87d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032097 Jul 31 14:28:14.259807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 387/751] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:28:14.319874 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7a2c118a-bcbc-400e-9d91-efd4a91364f8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:14.327651 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7a2c118a-bcbc-400e-9d91-efd4a91364f8 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd" status: 200 len: 1368 microversion: 2.1 time: 0.160896 Jul 31 14:28:14.328216 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 365/752] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:14 2022] GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:28:14.775734 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a504162d-069b-4dae-8997-4df8ad5b201b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:14.776424 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a504162d-069b-4dae-8997-4df8ad5b201b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:14.782570 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a504162d-069b-4dae-8997-4df8ad5b201b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:14.783023 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a504162d-069b-4dae-8997-4df8ad5b201b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:14.783805 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a504162d-069b-4dae-8997-4df8ad5b201b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:14.784240 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a504162d-069b-4dae-8997-4df8ad5b201b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:15.141374 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a504162d-069b-4dae-8997-4df8ad5b201b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:15.149579 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a504162d-069b-4dae-8997-4df8ad5b201b tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.378509 Jul 31 14:28:15.150152 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 388/753] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:14 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:28:15.248314 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-59fbc69b-3e9b-4135-8591-564601826331 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:15.248929 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-59fbc69b-3e9b-4135-8591-564601826331 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:15.256167 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-59fbc69b-3e9b-4135-8591-564601826331 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:15.256623 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-59fbc69b-3e9b-4135-8591-564601826331 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:15.257386 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-59fbc69b-3e9b-4135-8591-564601826331 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:15.257825 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-59fbc69b-3e9b-4135-8591-564601826331 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:15.350424 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-521a90e1-cf4d-48a6-ac99-170aa05c2527 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:15.351089 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-521a90e1-cf4d-48a6-ac99-170aa05c2527 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:15.357103 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-521a90e1-cf4d-48a6-ac99-170aa05c2527 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:15.357550 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-521a90e1-cf4d-48a6-ac99-170aa05c2527 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:15.358320 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-521a90e1-cf4d-48a6-ac99-170aa05c2527 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:15.358759 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-521a90e1-cf4d-48a6-ac99-170aa05c2527 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:15.390044 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-59fbc69b-3e9b-4135-8591-564601826331 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:15.398385 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-59fbc69b-3e9b-4135-8591-564601826331 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:15.399937 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-59fbc69b-3e9b-4135-8591-564601826331 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:15.401115 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-59fbc69b-3e9b-4135-8591-564601826331 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1725 microversion: 2.20 time: 0.156684 Jul 31 14:28:15.401683 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 366/754] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:15 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:15.485664 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-521a90e1-cf4d-48a6-ac99-170aa05c2527 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:15.493696 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-521a90e1-cf4d-48a6-ac99-170aa05c2527 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd" status: 200 len: 1368 microversion: 2.1 time: 0.147498 Jul 31 14:28:15.494290 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 389/755] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:15 2022] GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:28:16.170454 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-af217aa8-84c8-4593-80c4-b0117f485227 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:16.170982 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-af217aa8-84c8-4593-80c4-b0117f485227 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:16.177450 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-af217aa8-84c8-4593-80c4-b0117f485227 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:16.177900 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-af217aa8-84c8-4593-80c4-b0117f485227 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:16.178777 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-af217aa8-84c8-4593-80c4-b0117f485227 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:16.179354 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-af217aa8-84c8-4593-80c4-b0117f485227 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:16.424328 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-19b50e8c-c85d-448f-a21a-66c53e7d5f2e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:16.424961 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-19b50e8c-c85d-448f-a21a-66c53e7d5f2e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:16.431519 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-19b50e8c-c85d-448f-a21a-66c53e7d5f2e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:16.431978 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-19b50e8c-c85d-448f-a21a-66c53e7d5f2e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:16.432740 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-19b50e8c-c85d-448f-a21a-66c53e7d5f2e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:16.433171 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-19b50e8c-c85d-448f-a21a-66c53e7d5f2e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:16.567378 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-19b50e8c-c85d-448f-a21a-66c53e7d5f2e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:16.570097 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-af217aa8-84c8-4593-80c4-b0117f485227 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:16.576212 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-19b50e8c-c85d-448f-a21a-66c53e7d5f2e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:16.577719 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-19b50e8c-c85d-448f-a21a-66c53e7d5f2e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:16.577864 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-af217aa8-84c8-4593-80c4-b0117f485227 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1521 microversion: 2.1 time: 0.411372 Jul 31 14:28:16.578581 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 367/756] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:16 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1521 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:16.583273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-07980ade-ec0b-4cc7-8e4e-3329e0723212 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:16.583905 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-07980ade-ec0b-4cc7-8e4e-3329e0723212 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:16.587143 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-19b50e8c-c85d-448f-a21a-66c53e7d5f2e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1725 microversion: 2.20 time: 0.166748 Jul 31 14:28:16.587772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 390/757] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:16 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:28:16.590815 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-07980ade-ec0b-4cc7-8e4e-3329e0723212 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:16.591259 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-07980ade-ec0b-4cc7-8e4e-3329e0723212 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:16.592065 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-07980ade-ec0b-4cc7-8e4e-3329e0723212 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:16.592683 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-07980ade-ec0b-4cc7-8e4e-3329e0723212 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:16.778327 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-07980ade-ec0b-4cc7-8e4e-3329e0723212 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:16.785864 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-07980ade-ec0b-4cc7-8e4e-3329e0723212 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd" status: 200 len: 1368 microversion: 2.1 time: 0.206548 Jul 31 14:28:16.786434 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 368/758] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:16 2022] GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:16.933260 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-7e167edd-178e-41df-b153-8b51cb42ce16 req-7ebaa440-9622-401f-8aea-67d26930344d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712880e4-54c2-4ea2-b932-a8ff5efa0966", "name": "network-vif-deleted", "tag": "fd1b1c90-9fee-4c88-917b-cd367e44842e"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:28:16.943008 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-7e167edd-178e-41df-b153-8b51cb42ce16 req-7ebaa440-9622-401f-8aea-67d26930344d service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:16.943497 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-7e167edd-178e-41df-b153-8b51cb42ce16 req-7ebaa440-9622-401f-8aea-67d26930344d service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:16.954100 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-7e167edd-178e-41df-b153-8b51cb42ce16 req-7ebaa440-9622-401f-8aea-67d26930344d service nova] Creating event network-vif-deleted:fd1b1c90-9fee-4c88-917b-cd367e44842e for instance 712880e4-54c2-4ea2-b932-a8ff5efa0966 on hv-cinder-84984 Jul 31 14:28:16.958924 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-7e167edd-178e-41df-b153-8b51cb42ce16 req-7ebaa440-9622-401f-8aea-67d26930344d service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081744 Jul 31 14:28:16.959518 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 391/759] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:28:17.604462 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b6a22173-9e92-4aee-9835-c931a879358d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:17.605080 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b6a22173-9e92-4aee-9835-c931a879358d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:17.611636 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b6a22173-9e92-4aee-9835-c931a879358d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:17.612097 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b6a22173-9e92-4aee-9835-c931a879358d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:17.612858 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b6a22173-9e92-4aee-9835-c931a879358d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:17.613296 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b6a22173-9e92-4aee-9835-c931a879358d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:17.615745 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b9c70ee2-e8b6-4a43-8a32-9bdde688acd0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:17.616472 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b9c70ee2-e8b6-4a43-8a32-9bdde688acd0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:17.622798 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b9c70ee2-e8b6-4a43-8a32-9bdde688acd0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:17.623255 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b9c70ee2-e8b6-4a43-8a32-9bdde688acd0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:17.624051 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b9c70ee2-e8b6-4a43-8a32-9bdde688acd0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:17.624493 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b9c70ee2-e8b6-4a43-8a32-9bdde688acd0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:17.644458 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b6a22173-9e92-4aee-9835-c931a879358d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:17.644913 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b6a22173-9e92-4aee-9835-c931a879358d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:17.645369 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.objects.instance [None req-b6a22173-9e92-4aee-9835-c931a879358d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lazy-loading 'fault' on Instance uuid 712880e4-54c2-4ea2-b932-a8ff5efa0966 {{(pid=117781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:28:17.689106 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b6a22173-9e92-4aee-9835-c931a879358d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10a4469c46f64feb819f3b19a0f4e89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '832629dd8594494ab41b6596b2d73076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:17.697124 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b6a22173-9e92-4aee-9835-c931a879358d tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 200 len: 1311 microversion: 2.1 time: 0.096609 Jul 31 14:28:17.697790 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 369/760] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:17 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:17.761841 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b9c70ee2-e8b6-4a43-8a32-9bdde688acd0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:17.772042 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b9c70ee2-e8b6-4a43-8a32-9bdde688acd0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:17.775866 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b9c70ee2-e8b6-4a43-8a32-9bdde688acd0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:17.777948 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b9c70ee2-e8b6-4a43-8a32-9bdde688acd0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1725 microversion: 2.20 time: 0.167456 Jul 31 14:28:17.779161 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 392/761] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:17 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:28:17.806429 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-eec02994-8535-45e8-bfc4-6e7a2e36df54 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:17.807061 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-eec02994-8535-45e8-bfc4-6e7a2e36df54 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:17.813688 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eec02994-8535-45e8-bfc4-6e7a2e36df54 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:17.814160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eec02994-8535-45e8-bfc4-6e7a2e36df54 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:17.814926 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eec02994-8535-45e8-bfc4-6e7a2e36df54 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:17.815369 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eec02994-8535-45e8-bfc4-6e7a2e36df54 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:17.943121 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-eec02994-8535-45e8-bfc4-6e7a2e36df54 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:17.950810 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-eec02994-8535-45e8-bfc4-6e7a2e36df54 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd" status: 200 len: 1559 microversion: 2.1 time: 0.148070 Jul 31 14:28:17.951382 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 370/762] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:17 2022] GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:28:17.971357 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-29e8ae41-ce5c-42de-b778-b7a3aabb1ead tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:17.971902 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-29e8ae41-ce5c-42de-b778-b7a3aabb1ead tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:17.977968 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-29e8ae41-ce5c-42de-b778-b7a3aabb1ead tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:17.978406 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-29e8ae41-ce5c-42de-b778-b7a3aabb1ead tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:17.979151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-29e8ae41-ce5c-42de-b778-b7a3aabb1ead tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:17.979613 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-29e8ae41-ce5c-42de-b778-b7a3aabb1ead tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:18.053683 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-29e8ae41-ce5c-42de-b778-b7a3aabb1ead tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086064 Jul 31 14:28:18.054279 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 393/763] 10.222.0.40 () {58 vars in 1275 bytes} [Sun Jul 31 14:28:17 2022] GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd/os-interface => generated 285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:28:18.718082 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b3d116da-e7b8-4309-9f99-f5b83604f952 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:18.718693 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b3d116da-e7b8-4309-9f99-f5b83604f952 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] [instance: 712880e4-54c2-4ea2-b932-a8ff5efa0966] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:18.725600 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b3d116da-e7b8-4309-9f99-f5b83604f952 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:18.726051 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b3d116da-e7b8-4309-9f99-f5b83604f952 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:18.726816 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b3d116da-e7b8-4309-9f99-f5b83604f952 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:18.727251 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b3d116da-e7b8-4309-9f99-f5b83604f952 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:18.741329 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.wsgi [None req-b3d116da-e7b8-4309-9f99-f5b83604f952 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] HTTP exception thrown: Instance 712880e4-54c2-4ea2-b932-a8ff5efa0966 could not be found. Jul 31 14:28:18.742971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b3d116da-e7b8-4309-9f99-f5b83604f952 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Request method failure captured: Jul 31 14:28:18.742971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: request: GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 HTTP/1.1 Jul 31 14:28:18.742971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept: application/json Jul 31 14:28:18.742971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept-Encoding: identity Jul 31 14:28:18.742971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Connection: close Jul 31 14:28:18.742971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Length: 0 Jul 31 14:28:18.742971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Type: application/json Jul 31 14:28:18.742971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Host: 10.222.0.40 Jul 31 14:28:18.742971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Openstack-System-Scope: None Jul 31 14:28:18.742971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: User-Agent: python-urllib3/1.26.10 Jul 31 14:28:18.742971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Auth-Token: gAAAAABi5pBD72W1Rjv6at1WfVNUymNduY_N-nFbxGXJkrDc28rQU3JtMQkgCsFoz5JacBevK8YSVtt5PGEmj8VgqIeKUZCOYsB9PlAVGw4jymIy85OyVcpnTAbNXZcwZxntPYKfyuD8D6hHzBOe0TS_x7j6S_M-nQlq-6OQzOt_ElSF-AtfcFg Jul 31 14:28:18.742971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Id: None Jul 31 14:28:18.742971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Name: None Jul 31 14:28:18.742971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Identity-Status: Confirmed Jul 31 14:28:18.742971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Is-Admin-Project: True Jul 31 14:28:18.742971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Id: default Jul 31 14:28:18.742971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Name: Default Jul 31 14:28:18.742971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Id: 832629dd8594494ab41b6596b2d73076 Jul 31 14:28:18.742971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1831825154 Jul 31 14:28:18.742971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Role: reader,member Jul 31 14:28:18.742971 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Roles: reader,member Jul 31 14:28:18.744520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/832629dd8594494ab41b6596b2d73076"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_832629dd8594494ab41b6596b2d73076", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/832629dd8594494ab41b6596b2d73076"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/832629dd8594494ab41b6596b2d73076"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:28:18.744520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1831825154 Jul 31 14:28:18.744520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Id: 832629dd8594494ab41b6596b2d73076 Jul 31 14:28:18.744520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1831825154 Jul 31 14:28:18.744520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User: tempest-ServerRescueNegativeTestJSON-1831825154-project Jul 31 14:28:18.744520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Id: default Jul 31 14:28:18.744520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Name: Default Jul 31 14:28:18.744520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Id: 10a4469c46f64feb819f3b19a0f4e89b Jul 31 14:28:18.744520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1831825154-project Jul 31 14:28:18.744520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: method: > Jul 31 14:28:18.744520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: exception: Instance 712880e4-54c2-4ea2-b932-a8ff5efa0966 could not be found. Jul 31 14:28:18.744520 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: action_args: {'id': '712880e4-54c2-4ea2-b932-a8ff5efa0966'} Jul 31 14:28:18.745286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:28:18.745286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:28:18.745286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:28:18.745286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:28:18.745286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:28:18.745286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:28:18.745286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:28:18.745286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:28:18.745286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:28:18.745286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:28:18.745286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 712880e4-54c2-4ea2-b932-a8ff5efa0966 could not be found. Jul 31 14:28:18.745286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:28:18.745286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:28:18.745286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:28:18.745286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:28:18.745286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:28:18.745286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:28:18.745286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:28:18.745286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:28:18.745286 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:28:18.746440 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:28:18.746440 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:28:18.746440 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:28:18.746440 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:28:18.746440 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:28:18.746440 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:28:18.746440 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:28:18.746440 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 712880e4-54c2-4ea2-b932-a8ff5efa0966 could not be found. Jul 31 14:28:18.746440 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:28:18.746440 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:28:18.746440 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:28:18.746440 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:28:18.746440 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:28:18.746440 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:28:18.746440 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:28:18.746440 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:28:18.746440 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 712880e4-54c2-4ea2-b932-a8ff5efa0966 could not be found. Jul 31 14:28:18.746440 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:28:18.747543 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b3d116da-e7b8-4309-9f99-f5b83604f952 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] Returning 404 to user: Instance 712880e4-54c2-4ea2-b932-a8ff5efa0966 could not be found. {{(pid=117781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:28:18.747543 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b3d116da-e7b8-4309-9f99-f5b83604f952 tempest-ServerRescueNegativeTestJSON-1831825154 tempest-ServerRescueNegativeTestJSON-1831825154-project] 10.222.0.40 "GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966" status: 404 len: 111 microversion: 2.1 time: 0.030210 Jul 31 14:28:18.747543 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 371/764] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:18 2022] GET /compute/v2.1/servers/712880e4-54c2-4ea2-b932-a8ff5efa0966 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:28:18.802717 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d08cb8cd-445e-4ff4-bfd4-b3c0349237b0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:18.803517 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d08cb8cd-445e-4ff4-bfd4-b3c0349237b0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:18.809577 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d08cb8cd-445e-4ff4-bfd4-b3c0349237b0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:18.810093 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d08cb8cd-445e-4ff4-bfd4-b3c0349237b0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:18.811104 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d08cb8cd-445e-4ff4-bfd4-b3c0349237b0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:18.812059 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d08cb8cd-445e-4ff4-bfd4-b3c0349237b0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:19.029303 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d08cb8cd-445e-4ff4-bfd4-b3c0349237b0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:19.046008 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d08cb8cd-445e-4ff4-bfd4-b3c0349237b0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:19.048085 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d08cb8cd-445e-4ff4-bfd4-b3c0349237b0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:19.049500 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d08cb8cd-445e-4ff4-bfd4-b3c0349237b0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1725 microversion: 2.20 time: 0.251872 Jul 31 14:28:19.066740 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 394/765] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:18 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1725 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:28:19.079044 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-6f3dc838-f85d-4dfa-aacb-7aace3c4cd64 req-2825e20c-35aa-437c-bc7c-f992d5d4eb57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d6930f-fac2-4f58-996e-00224187cbbd", "tag": "cceca3ff-4dba-468b-9a2c-92275cf1a02c"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:28:19.094134 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-6f3dc838-f85d-4dfa-aacb-7aace3c4cd64 req-2825e20c-35aa-437c-bc7c-f992d5d4eb57 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:19.094821 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-6f3dc838-f85d-4dfa-aacb-7aace3c4cd64 req-2825e20c-35aa-437c-bc7c-f992d5d4eb57 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:19.106537 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-6f3dc838-f85d-4dfa-aacb-7aace3c4cd64 req-2825e20c-35aa-437c-bc7c-f992d5d4eb57 service nova] Creating event network-changed:cceca3ff-4dba-468b-9a2c-92275cf1a02c for instance 52d6930f-fac2-4f58-996e-00224187cbbd on hv-cinder-84984 Jul 31 14:28:19.111455 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-6f3dc838-f85d-4dfa-aacb-7aace3c4cd64 req-2825e20c-35aa-437c-bc7c-f992d5d4eb57 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036272 Jul 31 14:28:19.112120 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 372/766] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:28:20.072924 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-75d9093d-d8a0-4cb1-ab53-8c423d23c45b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:20.073547 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-75d9093d-d8a0-4cb1-ab53-8c423d23c45b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:20.080932 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-75d9093d-d8a0-4cb1-ab53-8c423d23c45b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:20.081417 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-75d9093d-d8a0-4cb1-ab53-8c423d23c45b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:20.082392 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-75d9093d-d8a0-4cb1-ab53-8c423d23c45b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:20.082822 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-75d9093d-d8a0-4cb1-ab53-8c423d23c45b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:20.233183 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-75d9093d-d8a0-4cb1-ab53-8c423d23c45b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:20.254352 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-75d9093d-d8a0-4cb1-ab53-8c423d23c45b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:20.255989 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-75d9093d-d8a0-4cb1-ab53-8c423d23c45b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:20.257187 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-75d9093d-d8a0-4cb1-ab53-8c423d23c45b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1725 microversion: 2.20 time: 0.188087 Jul 31 14:28:20.258142 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 395/767] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:20 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:21.280837 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-c88470bb-2e91-4145-98ff-18e2164a1c1d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:21.282165 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-c88470bb-2e91-4145-98ff-18e2164a1c1d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:21.294236 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c88470bb-2e91-4145-98ff-18e2164a1c1d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:21.294236 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c88470bb-2e91-4145-98ff-18e2164a1c1d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:21.294236 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c88470bb-2e91-4145-98ff-18e2164a1c1d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:21.295198 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c88470bb-2e91-4145-98ff-18e2164a1c1d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:21.810023 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c88470bb-2e91-4145-98ff-18e2164a1c1d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:21.818433 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c88470bb-2e91-4145-98ff-18e2164a1c1d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:21.819969 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c88470bb-2e91-4145-98ff-18e2164a1c1d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:21.821123 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-c88470bb-2e91-4145-98ff-18e2164a1c1d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1725 microversion: 2.20 time: 0.544593 Jul 31 14:28:21.821697 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 373/768] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:21 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1725 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:22.844906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1ba1bd93-dcef-430b-9442-aa4224e40949 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:22.846182 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1ba1bd93-dcef-430b-9442-aa4224e40949 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:22.853168 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1ba1bd93-dcef-430b-9442-aa4224e40949 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:22.853728 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1ba1bd93-dcef-430b-9442-aa4224e40949 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:22.854633 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1ba1bd93-dcef-430b-9442-aa4224e40949 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:22.855078 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1ba1bd93-dcef-430b-9442-aa4224e40949 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:22.859656 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:28:22.995514 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1ba1bd93-dcef-430b-9442-aa4224e40949 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:23.005213 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1ba1bd93-dcef-430b-9442-aa4224e40949 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:23.007154 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1ba1bd93-dcef-430b-9442-aa4224e40949 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:23.008737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1ba1bd93-dcef-430b-9442-aa4224e40949 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1725 microversion: 2.20 time: 0.167627 Jul 31 14:28:23.009379 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 396/769] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:22 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:24.032245 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-a29358ad-d4c0-4352-9c77-08a599c71784 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:24.032958 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-a29358ad-d4c0-4352-9c77-08a599c71784 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:24.040120 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a29358ad-d4c0-4352-9c77-08a599c71784 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:24.040769 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a29358ad-d4c0-4352-9c77-08a599c71784 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:24.042036 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a29358ad-d4c0-4352-9c77-08a599c71784 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:24.042036 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a29358ad-d4c0-4352-9c77-08a599c71784 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:24.178546 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a29358ad-d4c0-4352-9c77-08a599c71784 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:24.186750 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a29358ad-d4c0-4352-9c77-08a599c71784 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:24.188454 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a29358ad-d4c0-4352-9c77-08a599c71784 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:24.189728 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-a29358ad-d4c0-4352-9c77-08a599c71784 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1725 microversion: 2.20 time: 0.161402 Jul 31 14:28:24.190311 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 374/770] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:24 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:25.212318 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-03c4abd8-7425-404c-91a9-ecc103504e6d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:25.212927 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-03c4abd8-7425-404c-91a9-ecc103504e6d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:25.219509 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-03c4abd8-7425-404c-91a9-ecc103504e6d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:25.219959 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-03c4abd8-7425-404c-91a9-ecc103504e6d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:25.220722 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-03c4abd8-7425-404c-91a9-ecc103504e6d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:25.221159 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-03c4abd8-7425-404c-91a9-ecc103504e6d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:25.351243 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-03c4abd8-7425-404c-91a9-ecc103504e6d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:25.359240 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-03c4abd8-7425-404c-91a9-ecc103504e6d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:25.360786 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-03c4abd8-7425-404c-91a9-ecc103504e6d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:25.361944 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-03c4abd8-7425-404c-91a9-ecc103504e6d tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1725 microversion: 2.20 time: 0.153579 Jul 31 14:28:25.363144 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 397/771] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:25 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:26.385715 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-1b8e6471-b055-4d10-b435-afc9b9ed997a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:26.386333 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-1b8e6471-b055-4d10-b435-afc9b9ed997a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:26.394139 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1b8e6471-b055-4d10-b435-afc9b9ed997a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:26.394983 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1b8e6471-b055-4d10-b435-afc9b9ed997a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:26.395894 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1b8e6471-b055-4d10-b435-afc9b9ed997a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:26.396562 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1b8e6471-b055-4d10-b435-afc9b9ed997a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:26.544396 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-1b8e6471-b055-4d10-b435-afc9b9ed997a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:26.552817 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-1b8e6471-b055-4d10-b435-afc9b9ed997a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:26.554337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-1b8e6471-b055-4d10-b435-afc9b9ed997a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:26.555519 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-1b8e6471-b055-4d10-b435-afc9b9ed997a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1725 microversion: 2.20 time: 0.173809 Jul 31 14:28:26.556088 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 375/772] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:26 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:27.579748 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-995a1eff-9215-4363-bcf7-a3f5271ccae5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:27.580361 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-995a1eff-9215-4363-bcf7-a3f5271ccae5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:27.587562 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-995a1eff-9215-4363-bcf7-a3f5271ccae5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:27.588013 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-995a1eff-9215-4363-bcf7-a3f5271ccae5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:27.588784 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-995a1eff-9215-4363-bcf7-a3f5271ccae5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:27.589220 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-995a1eff-9215-4363-bcf7-a3f5271ccae5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:27.722218 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-995a1eff-9215-4363-bcf7-a3f5271ccae5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:27.731786 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-995a1eff-9215-4363-bcf7-a3f5271ccae5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:27.733308 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-995a1eff-9215-4363-bcf7-a3f5271ccae5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:27.734463 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-995a1eff-9215-4363-bcf7-a3f5271ccae5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1725 microversion: 2.20 time: 0.158979 Jul 31 14:28:27.735038 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 398/773] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:27 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:28.757550 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-a2711af6-1a77-4c8c-9e06-41bd1de96eef tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:28.758161 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-a2711af6-1a77-4c8c-9e06-41bd1de96eef tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:28.764748 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a2711af6-1a77-4c8c-9e06-41bd1de96eef tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:28.765197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a2711af6-1a77-4c8c-9e06-41bd1de96eef tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:28.765958 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a2711af6-1a77-4c8c-9e06-41bd1de96eef tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:28.766393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a2711af6-1a77-4c8c-9e06-41bd1de96eef tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:28.902198 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a2711af6-1a77-4c8c-9e06-41bd1de96eef tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:28.905785 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:28:28.911899 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a2711af6-1a77-4c8c-9e06-41bd1de96eef tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:28.913403 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a2711af6-1a77-4c8c-9e06-41bd1de96eef tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:28.914760 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-a2711af6-1a77-4c8c-9e06-41bd1de96eef tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1725 microversion: 2.20 time: 0.161150 Jul 31 14:28:28.915439 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 376/774] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:28 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:29.937031 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-de27dfeb-6ee9-42b2-9195-2ffdf91d50fb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:29.937697 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-de27dfeb-6ee9-42b2-9195-2ffdf91d50fb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:29.945788 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-de27dfeb-6ee9-42b2-9195-2ffdf91d50fb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:29.946290 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-de27dfeb-6ee9-42b2-9195-2ffdf91d50fb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:29.947501 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-de27dfeb-6ee9-42b2-9195-2ffdf91d50fb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:29.947947 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-de27dfeb-6ee9-42b2-9195-2ffdf91d50fb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:30.079169 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-de27dfeb-6ee9-42b2-9195-2ffdf91d50fb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:30.087633 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-de27dfeb-6ee9-42b2-9195-2ffdf91d50fb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:30.089147 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-de27dfeb-6ee9-42b2-9195-2ffdf91d50fb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:30.090297 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-de27dfeb-6ee9-42b2-9195-2ffdf91d50fb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1725 microversion: 2.20 time: 0.157291 Jul 31 14:28:30.090858 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 399/775] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:29 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:31.114830 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-76d040d5-0ad7-4a2b-a0b0-09ec0359b725 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:31.115470 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-76d040d5-0ad7-4a2b-a0b0-09ec0359b725 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:31.124320 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-76d040d5-0ad7-4a2b-a0b0-09ec0359b725 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:31.124773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-76d040d5-0ad7-4a2b-a0b0-09ec0359b725 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:31.125544 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-76d040d5-0ad7-4a2b-a0b0-09ec0359b725 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:31.125983 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-76d040d5-0ad7-4a2b-a0b0-09ec0359b725 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:31.261378 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-76d040d5-0ad7-4a2b-a0b0-09ec0359b725 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:31.269770 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-76d040d5-0ad7-4a2b-a0b0-09ec0359b725 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:31.271285 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-76d040d5-0ad7-4a2b-a0b0-09ec0359b725 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:31.272479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-76d040d5-0ad7-4a2b-a0b0-09ec0359b725 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1746 microversion: 2.20 time: 0.163214 Jul 31 14:28:31.273042 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 377/776] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:31 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:32.297547 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ef61712b-ddc3-46f7-8504-1d7f3836fee5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:32.298093 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ef61712b-ddc3-46f7-8504-1d7f3836fee5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:32.300409 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:28:32.306150 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ef61712b-ddc3-46f7-8504-1d7f3836fee5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:32.306628 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ef61712b-ddc3-46f7-8504-1d7f3836fee5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:32.307397 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ef61712b-ddc3-46f7-8504-1d7f3836fee5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:32.307861 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ef61712b-ddc3-46f7-8504-1d7f3836fee5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:32.442439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ef61712b-ddc3-46f7-8504-1d7f3836fee5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:32.450594 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ef61712b-ddc3-46f7-8504-1d7f3836fee5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:32.452132 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ef61712b-ddc3-46f7-8504-1d7f3836fee5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:32.453289 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ef61712b-ddc3-46f7-8504-1d7f3836fee5 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1746 microversion: 2.20 time: 0.159708 Jul 31 14:28:32.453848 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 400/777] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:32 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:33.103444 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-07316f20-5a11-43be-b735-73281b251e19 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-402018921"}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:28:33.103988 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-07316f20-5a11-43be-b735-73281b251e19 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:33.110769 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-07316f20-5a11-43be-b735-73281b251e19 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:33.111217 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-07316f20-5a11-43be-b735-73281b251e19 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:33.112001 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-07316f20-5a11-43be-b735-73281b251e19 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:33.112461 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-07316f20-5a11-43be-b735-73281b251e19 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:33.247504 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.network.security_group_api [None req-07316f20-5a11-43be-b735-73281b251e19 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Removing security group 372ee9d5-843c-4213-9990-b78b9ccb5c27 from port 2da882f0-72a7-499f-8313-43b198253581 Jul 31 14:28:33.476822 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d1ec74d3-6a9b-4dc6-bb76-aa6cd5ed21e6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:33.478453 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d1ec74d3-6a9b-4dc6-bb76-aa6cd5ed21e6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:33.485166 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d1ec74d3-6a9b-4dc6-bb76-aa6cd5ed21e6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:33.485763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d1ec74d3-6a9b-4dc6-bb76-aa6cd5ed21e6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:33.486637 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d1ec74d3-6a9b-4dc6-bb76-aa6cd5ed21e6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:33.487332 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d1ec74d3-6a9b-4dc6-bb76-aa6cd5ed21e6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:33.598083 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-07316f20-5a11-43be-b735-73281b251e19 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "POST /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7/action" status: 202 len: 0 microversion: 2.1 time: 0.498506 Jul 31 14:28:33.604386 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 378/778] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Jul 31 14:28:33 2022] POST /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:28:33.636688 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-0fb1bb9f-c984-49cf-b197-670c5f445892 req-cac4e367-417c-4bad-a9b3-9b432e633c54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb0fe7f8-51ab-4016-9142-4a9d2fda34a7", "tag": "2da882f0-72a7-499f-8313-43b198253581"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:28:33.647162 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d1ec74d3-6a9b-4dc6-bb76-aa6cd5ed21e6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:33.654089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-0fb1bb9f-c984-49cf-b197-670c5f445892 req-cac4e367-417c-4bad-a9b3-9b432e633c54 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:33.656163 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-0fb1bb9f-c984-49cf-b197-670c5f445892 req-cac4e367-417c-4bad-a9b3-9b432e633c54 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:33.671188 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d1ec74d3-6a9b-4dc6-bb76-aa6cd5ed21e6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:33.673713 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-0fb1bb9f-c984-49cf-b197-670c5f445892 req-cac4e367-417c-4bad-a9b3-9b432e633c54 service nova] Creating event network-changed:2da882f0-72a7-499f-8313-43b198253581 for instance fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 on hv-cinder-84984 Jul 31 14:28:33.673843 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d1ec74d3-6a9b-4dc6-bb76-aa6cd5ed21e6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:33.678316 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d1ec74d3-6a9b-4dc6-bb76-aa6cd5ed21e6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1741 microversion: 2.20 time: 0.205841 Jul 31 14:28:33.680315 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-0fb1bb9f-c984-49cf-b197-670c5f445892 req-cac4e367-417c-4bad-a9b3-9b432e633c54 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050553 Jul 31 14:28:33.680544 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 401/779] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:33 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1741 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 31 14:28:33.692533 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 379/780] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:28:34.705602 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-dccaf321-4884-4da3-9951-4c185f369d65 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:34.706840 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-dccaf321-4884-4da3-9951-4c185f369d65 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:34.716119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dccaf321-4884-4da3-9951-4c185f369d65 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:34.718881 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dccaf321-4884-4da3-9951-4c185f369d65 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:34.722468 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dccaf321-4884-4da3-9951-4c185f369d65 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:34.725370 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dccaf321-4884-4da3-9951-4c185f369d65 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:34.990110 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-dccaf321-4884-4da3-9951-4c185f369d65 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:35.013486 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-dccaf321-4884-4da3-9951-4c185f369d65 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:35.023777 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-dccaf321-4884-4da3-9951-4c185f369d65 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:35.032917 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-dccaf321-4884-4da3-9951-4c185f369d65 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1741 microversion: 2.20 time: 0.328178 Jul 31 14:28:35.035998 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 402/781] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:34 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1741 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:35.245077 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-62ac88ca-bf6b-4e52-bf17-decf178da716 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:35.245782 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-62ac88ca-bf6b-4e52-bf17-decf178da716 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:35.256470 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-62ac88ca-bf6b-4e52-bf17-decf178da716 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:35.258487 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-62ac88ca-bf6b-4e52-bf17-decf178da716 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:35.259623 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-62ac88ca-bf6b-4e52-bf17-decf178da716 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:35.260073 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-62ac88ca-bf6b-4e52-bf17-decf178da716 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:35.379572 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.objects.instance [None req-62ac88ca-bf6b-4e52-bf17-decf178da716 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lazy-loading 'services' on Instance uuid fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 {{(pid=117781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:28:35.433168 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-76758b29-fd77-4bb7-a91f-57c83eb9e563 req-14e10e60-a648-4b01-bacb-ca09329ce24f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb0fe7f8-51ab-4016-9142-4a9d2fda34a7", "tag": "2da882f0-72a7-499f-8313-43b198253581"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:28:35.449322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-76758b29-fd77-4bb7-a91f-57c83eb9e563 req-14e10e60-a648-4b01-bacb-ca09329ce24f service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:35.450096 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-76758b29-fd77-4bb7-a91f-57c83eb9e563 req-14e10e60-a648-4b01-bacb-ca09329ce24f service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:35.471877 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-76758b29-fd77-4bb7-a91f-57c83eb9e563 req-14e10e60-a648-4b01-bacb-ca09329ce24f service nova] Creating event network-changed:2da882f0-72a7-499f-8313-43b198253581 for instance fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 on hv-cinder-84984 Jul 31 14:28:35.478157 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-62ac88ca-bf6b-4e52-bf17-decf178da716 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7/os-volume_attachments/4bf6503c-44e6-4c33-894b-09afb72e0fc6" status: 202 len: 0 microversion: 2.1 time: 0.244228 Jul 31 14:28:35.483875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-76758b29-fd77-4bb7-a91f-57c83eb9e563 req-14e10e60-a648-4b01-bacb-ca09329ce24f service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.247186 Jul 31 14:28:35.485330 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 380/782] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Jul 31 14:28:35 2022] DELETE /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7/os-volume_attachments/4bf6503c-44e6-4c33-894b-09afb72e0fc6 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:28:35.493805 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-ff920b61-5513-49e4-a89a-c20ad3d5ec51 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:35.496534 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 403/783] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:28:35.496666 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-ff920b61-5513-49e4-a89a-c20ad3d5ec51 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:35.503916 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ff920b61-5513-49e4-a89a-c20ad3d5ec51 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:35.504361 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ff920b61-5513-49e4-a89a-c20ad3d5ec51 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:35.505167 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ff920b61-5513-49e4-a89a-c20ad3d5ec51 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:35.505749 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ff920b61-5513-49e4-a89a-c20ad3d5ec51 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:35.543099 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-ff920b61-5513-49e4-a89a-c20ad3d5ec51 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056081 Jul 31 14:28:35.544322 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 381/784] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Jul 31 14:28:35 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:28:36.058775 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1d8547e3-4fd7-4903-8e9c-80e122b34061 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:36.060389 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1d8547e3-4fd7-4903-8e9c-80e122b34061 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:36.075626 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d8547e3-4fd7-4903-8e9c-80e122b34061 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:36.076571 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d8547e3-4fd7-4903-8e9c-80e122b34061 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:36.077531 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d8547e3-4fd7-4903-8e9c-80e122b34061 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:36.079576 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d8547e3-4fd7-4903-8e9c-80e122b34061 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:36.297610 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1d8547e3-4fd7-4903-8e9c-80e122b34061 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:36.306040 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1d8547e3-4fd7-4903-8e9c-80e122b34061 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:36.307593 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1d8547e3-4fd7-4903-8e9c-80e122b34061 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:36.308780 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1d8547e3-4fd7-4903-8e9c-80e122b34061 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1741 microversion: 2.20 time: 0.254722 Jul 31 14:28:36.309344 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 404/785] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:36 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1741 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:36.564484 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-61196aba-58e9-40ae-9a30-1018f06d2260 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:36.571140 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-61196aba-58e9-40ae-9a30-1018f06d2260 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:36.581685 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-61196aba-58e9-40ae-9a30-1018f06d2260 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:36.582373 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-61196aba-58e9-40ae-9a30-1018f06d2260 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:36.583355 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-61196aba-58e9-40ae-9a30-1018f06d2260 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:36.584018 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-61196aba-58e9-40ae-9a30-1018f06d2260 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:36.698260 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-61196aba-58e9-40ae-9a30-1018f06d2260 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.138240 Jul 31 14:28:36.702370 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 382/786] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Jul 31 14:28:36 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7/os-volume_attachments => generated 25 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 14:28:36.714128 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-c47c20da-f5ff-42b3-9388-d54999d46cd6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:36.721319 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-c47c20da-f5ff-42b3-9388-d54999d46cd6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:36.737305 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c47c20da-f5ff-42b3-9388-d54999d46cd6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:36.737757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c47c20da-f5ff-42b3-9388-d54999d46cd6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:36.738957 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c47c20da-f5ff-42b3-9388-d54999d46cd6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:36.739403 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c47c20da-f5ff-42b3-9388-d54999d46cd6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:36.754896 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-670061a1-bf54-4fa9-a5d7-667e110cf40f req-efb3c2c8-1bf9-4ae5-9b74-992337fa4039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6200d587-a817-4a77-b242-ec578e8e57dc", "name": "network-vif-plugged", "status": "completed", "tag": "414cf0f9-b0cd-4363-9160-1242693140a5"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:28:36.777979 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-670061a1-bf54-4fa9-a5d7-667e110cf40f req-efb3c2c8-1bf9-4ae5-9b74-992337fa4039 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:36.778644 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-670061a1-bf54-4fa9-a5d7-667e110cf40f req-efb3c2c8-1bf9-4ae5-9b74-992337fa4039 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:36.799112 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-670061a1-bf54-4fa9-a5d7-667e110cf40f req-efb3c2c8-1bf9-4ae5-9b74-992337fa4039 service nova] Creating event network-vif-plugged:414cf0f9-b0cd-4363-9160-1242693140a5 for instance 6200d587-a817-4a77-b242-ec578e8e57dc on hv-cinder-84984 Jul 31 14:28:36.816836 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-670061a1-bf54-4fa9-a5d7-667e110cf40f req-efb3c2c8-1bf9-4ae5-9b74-992337fa4039 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211995 Jul 31 14:28:36.817798 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 405/787] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:28:36.907509 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.wsgi [None req-c47c20da-f5ff-42b3-9388-d54999d46cd6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] HTTP exception thrown: Instance fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 is not attached to volume 4bf6503c-44e6-4c33-894b-09afb72e0fc6 Jul 31 14:28:36.911350 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-c47c20da-f5ff-42b3-9388-d54999d46cd6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Request method failure captured: Jul 31 14:28:36.911350 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: request: DELETE /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7/os-volume_attachments/4bf6503c-44e6-4c33-894b-09afb72e0fc6 HTTP/1.1 Jul 31 14:28:36.911350 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept: application/json Jul 31 14:28:36.911350 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept-Encoding: identity Jul 31 14:28:36.911350 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Connection: close Jul 31 14:28:36.911350 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Length: 0 Jul 31 14:28:36.911350 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Type: application/json Jul 31 14:28:36.911350 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Host: 10.222.0.40 Jul 31 14:28:36.911350 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Openstack-System-Scope: None Jul 31 14:28:36.911350 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: User-Agent: python-urllib3/1.26.10 Jul 31 14:28:36.911350 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Auth-Token: gAAAAABi5pECUxelprg8xHeybtTtOuIJiu8dsW7ulHEByBnV4JwOQuGTiA-74HwtOD95Bvi8AYEbgfX7zHoeIOD90V59NZKPUFwh3dIBXWiSrkZhOIFbJbUiDCwvUrvrrQdmEDF2rKZQapGSp7DrCHJEk8tyKs1tcXuiyK8uA8PZHgaFtCRQJbE Jul 31 14:28:36.911350 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Id: None Jul 31 14:28:36.911350 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Name: None Jul 31 14:28:36.911350 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Identity-Status: Confirmed Jul 31 14:28:36.911350 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Is-Admin-Project: True Jul 31 14:28:36.911350 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Id: default Jul 31 14:28:36.911350 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Name: Default Jul 31 14:28:36.911350 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Id: ea0d7081bf384d098fad20ef507f4dfd Jul 31 14:28:36.911350 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Name: tempest-TestMinimumBasicScenario-1515215193 Jul 31 14:28:36.911350 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Role: reader,member Jul 31 14:28:36.911350 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Roles: reader,member Jul 31 14:28:36.912954 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea0d7081bf384d098fad20ef507f4dfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea0d7081bf384d098fad20ef507f4dfd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea0d7081bf384d098fad20ef507f4dfd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea0d7081bf384d098fad20ef507f4dfd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:28:36.912954 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant: tempest-TestMinimumBasicScenario-1515215193 Jul 31 14:28:36.912954 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Id: ea0d7081bf384d098fad20ef507f4dfd Jul 31 14:28:36.912954 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1515215193 Jul 31 14:28:36.912954 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User: tempest-TestMinimumBasicScenario-1515215193-project Jul 31 14:28:36.912954 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Id: default Jul 31 14:28:36.912954 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Name: Default Jul 31 14:28:36.912954 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Id: 3b003c297b914cb08f737b1f4d40b16d Jul 31 14:28:36.912954 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Name: tempest-TestMinimumBasicScenario-1515215193-project Jul 31 14:28:36.912954 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: method: > Jul 31 14:28:36.912954 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: exception: Instance fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 is not attached to volume 4bf6503c-44e6-4c33-894b-09afb72e0fc6 Jul 31 14:28:36.913794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: action_args: {'server_id': 'fb0fe7f8-51ab-4016-9142-4a9d2fda34a7', 'id': '4bf6503c-44e6-4c33-894b-09afb72e0fc6'} Jul 31 14:28:36.913794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:28:36.913794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:28:36.913794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 31 14:28:36.913794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 31 14:28:36.913794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 31 14:28:36.913794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 31 14:28:36.913794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 31 14:28:36.913794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 31 14:28:36.913794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4bf6503c-44e6-4c33-894b-09afb72e0fc6. Jul 31 14:28:36.913794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:28:36.913794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:28:36.913794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:28:36.913794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:28:36.913794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:28:36.913794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:28:36.913794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:28:36.913794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:28:36.913794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:28:36.915243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:28:36.915243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 31 14:28:36.915243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 31 14:28:36.915243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 is not attached to volume 4bf6503c-44e6-4c33-894b-09afb72e0fc6 Jul 31 14:28:36.915243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:28:36.915243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:28:36.915243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:28:36.915243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:28:36.915243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:28:36.915243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:28:36.915243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:28:36.915243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:28:36.915243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 is not attached to volume 4bf6503c-44e6-4c33-894b-09afb72e0fc6 Jul 31 14:28:36.915243 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:28:36.922251 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-c47c20da-f5ff-42b3-9388-d54999d46cd6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Returning 404 to user: Instance fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 is not attached to volume 4bf6503c-44e6-4c33-894b-09afb72e0fc6 {{(pid=117781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:28:36.925108 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-c47c20da-f5ff-42b3-9388-d54999d46cd6 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7/os-volume_attachments/4bf6503c-44e6-4c33-894b-09afb72e0fc6" status: 404 len: 154 microversion: 2.1 time: 0.216739 Jul 31 14:28:36.931357 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 383/788] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Jul 31 14:28:36 2022] DELETE /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7/os-volume_attachments/4bf6503c-44e6-4c33-894b-09afb72e0fc6 => generated 154 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:28:37.333469 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-907679c2-38c0-4eb6-bac6-df64d3997062 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:37.334839 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-907679c2-38c0-4eb6-bac6-df64d3997062 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:37.343362 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-907679c2-38c0-4eb6-bac6-df64d3997062 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:37.344034 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-907679c2-38c0-4eb6-bac6-df64d3997062 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:37.345010 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-907679c2-38c0-4eb6-bac6-df64d3997062 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:37.345615 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-907679c2-38c0-4eb6-bac6-df64d3997062 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:37.885345 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-907679c2-38c0-4eb6-bac6-df64d3997062 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:37.894515 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-907679c2-38c0-4eb6-bac6-df64d3997062 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:37.896363 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-907679c2-38c0-4eb6-bac6-df64d3997062 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:37.897799 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-907679c2-38c0-4eb6-bac6-df64d3997062 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1741 microversion: 2.20 time: 0.568995 Jul 31 14:28:37.912032 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 406/789] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:37 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1741 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:38.116879 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b890052e-07b9-42ff-b8a7-d8724d000c41 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:38.118008 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b890052e-07b9-42ff-b8a7-d8724d000c41 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:38.124707 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b890052e-07b9-42ff-b8a7-d8724d000c41 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:38.125158 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b890052e-07b9-42ff-b8a7-d8724d000c41 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:38.126193 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b890052e-07b9-42ff-b8a7-d8724d000c41 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:38.126695 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b890052e-07b9-42ff-b8a7-d8724d000c41 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:38.155649 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b890052e-07b9-42ff-b8a7-d8724d000c41 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Going to try to terminate instance {{(pid=117781) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 14:28:38.245002 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b890052e-07b9-42ff-b8a7-d8724d000c41 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "DELETE /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 204 len: 0 microversion: 2.1 time: 0.132624 Jul 31 14:28:38.245786 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 384/790] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:28:38 2022] DELETE /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 14:28:38.254443 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d151a08d-a2e1-42f2-9635-f6564c3a8269 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:38.255056 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d151a08d-a2e1-42f2-9635-f6564c3a8269 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:38.262126 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d151a08d-a2e1-42f2-9635-f6564c3a8269 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:38.263114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d151a08d-a2e1-42f2-9635-f6564c3a8269 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:38.263359 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d151a08d-a2e1-42f2-9635-f6564c3a8269 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:38.272368 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d151a08d-a2e1-42f2-9635-f6564c3a8269 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:38.425696 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d151a08d-a2e1-42f2-9635-f6564c3a8269 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:38.434926 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d151a08d-a2e1-42f2-9635-f6564c3a8269 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1553 microversion: 2.1 time: 0.184563 Jul 31 14:28:38.435948 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 407/791] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:38 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:38.923116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7193675d-4eb9-4a4e-aafb-3a3d89f1435e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:38.924178 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7193675d-4eb9-4a4e-aafb-3a3d89f1435e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:38.930947 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7193675d-4eb9-4a4e-aafb-3a3d89f1435e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:38.931262 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7193675d-4eb9-4a4e-aafb-3a3d89f1435e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:38.931981 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7193675d-4eb9-4a4e-aafb-3a3d89f1435e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:38.932586 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7193675d-4eb9-4a4e-aafb-3a3d89f1435e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:39.097583 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7193675d-4eb9-4a4e-aafb-3a3d89f1435e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:39.110997 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7193675d-4eb9-4a4e-aafb-3a3d89f1435e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:39.112636 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7193675d-4eb9-4a4e-aafb-3a3d89f1435e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:39.113973 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7193675d-4eb9-4a4e-aafb-3a3d89f1435e tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1741 microversion: 2.20 time: 0.195329 Jul 31 14:28:39.114598 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 385/792] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:38 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1741 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:39.457488 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-22b166ed-490d-4d03-aaf1-6f4dfd022426 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:39.458245 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-22b166ed-490d-4d03-aaf1-6f4dfd022426 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:39.465078 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-22b166ed-490d-4d03-aaf1-6f4dfd022426 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:39.465531 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-22b166ed-490d-4d03-aaf1-6f4dfd022426 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:39.466303 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-22b166ed-490d-4d03-aaf1-6f4dfd022426 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:39.466737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-22b166ed-490d-4d03-aaf1-6f4dfd022426 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:39.608394 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-22b166ed-490d-4d03-aaf1-6f4dfd022426 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:39.616525 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-22b166ed-490d-4d03-aaf1-6f4dfd022426 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1553 microversion: 2.1 time: 0.163281 Jul 31 14:28:39.617108 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 408/793] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:39 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:40.138341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-57d64218-4ebd-4f56-9509-0ac628053866 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:40.141052 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-57d64218-4ebd-4f56-9509-0ac628053866 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:40.150129 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-57d64218-4ebd-4f56-9509-0ac628053866 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:40.150672 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-57d64218-4ebd-4f56-9509-0ac628053866 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:40.152042 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-57d64218-4ebd-4f56-9509-0ac628053866 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:40.152652 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-57d64218-4ebd-4f56-9509-0ac628053866 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:40.345823 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-57d64218-4ebd-4f56-9509-0ac628053866 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:40.356333 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-57d64218-4ebd-4f56-9509-0ac628053866 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:40.358325 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-57d64218-4ebd-4f56-9509-0ac628053866 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:40.359756 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-57d64218-4ebd-4f56-9509-0ac628053866 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1741 microversion: 2.20 time: 0.225622 Jul 31 14:28:40.368298 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 386/794] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:40 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1741 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:40.642907 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e1acba19-10a0-4108-a751-21a1236a2e3a tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:40.646204 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e1acba19-10a0-4108-a751-21a1236a2e3a tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:40.653538 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e1acba19-10a0-4108-a751-21a1236a2e3a tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:40.654520 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e1acba19-10a0-4108-a751-21a1236a2e3a tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:40.655884 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e1acba19-10a0-4108-a751-21a1236a2e3a tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:40.656474 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e1acba19-10a0-4108-a751-21a1236a2e3a tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:40.938937 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e1acba19-10a0-4108-a751-21a1236a2e3a tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b003c297b914cb08f737b1f4d40b16d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea0d7081bf384d098fad20ef507f4dfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:40.949236 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e1acba19-10a0-4108-a751-21a1236a2e3a tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 200 len: 1511 microversion: 2.1 time: 0.314667 Jul 31 14:28:40.964125 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-cfd9c396-b1b6-4fbd-96e8-b8da0ca8185a req-5eff560b-5547-42c0-b48a-4302c926a97b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0fe7f8-51ab-4016-9142-4a9d2fda34a7", "name": "network-vif-deleted", "tag": "2da882f0-72a7-499f-8313-43b198253581"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:28:40.964377 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 409/795] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:40 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 1511 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:28:40.964474 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-cfd9c396-b1b6-4fbd-96e8-b8da0ca8185a req-5eff560b-5547-42c0-b48a-4302c926a97b service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:40.964474 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-cfd9c396-b1b6-4fbd-96e8-b8da0ca8185a req-5eff560b-5547-42c0-b48a-4302c926a97b service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:40.975087 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-cfd9c396-b1b6-4fbd-96e8-b8da0ca8185a req-5eff560b-5547-42c0-b48a-4302c926a97b service nova] Creating event network-vif-deleted:2da882f0-72a7-499f-8313-43b198253581 for instance fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 on hv-cinder-84984 Jul 31 14:28:40.980294 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-cfd9c396-b1b6-4fbd-96e8-b8da0ca8185a req-5eff560b-5547-42c0-b48a-4302c926a97b service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032049 Jul 31 14:28:40.981241 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 387/796] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:28:41.383733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-016d0cae-786e-4cb5-a529-0555da993bb8 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:41.384820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-016d0cae-786e-4cb5-a529-0555da993bb8 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:41.391194 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-016d0cae-786e-4cb5-a529-0555da993bb8 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:41.391953 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-016d0cae-786e-4cb5-a529-0555da993bb8 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:41.392895 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-016d0cae-786e-4cb5-a529-0555da993bb8 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:41.394123 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-016d0cae-786e-4cb5-a529-0555da993bb8 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:41.556088 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-016d0cae-786e-4cb5-a529-0555da993bb8 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:41.576970 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-016d0cae-786e-4cb5-a529-0555da993bb8 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:41.578842 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-016d0cae-786e-4cb5-a529-0555da993bb8 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:41.581294 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-016d0cae-786e-4cb5-a529-0555da993bb8 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1741 microversion: 2.20 time: 0.200535 Jul 31 14:28:41.582078 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 410/797] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:41 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1741 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:41.972389 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-e0bcbbb5-b323-487e-8c83-58fae0915d1a tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:41.973381 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-e0bcbbb5-b323-487e-8c83-58fae0915d1a tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] [instance: fb0fe7f8-51ab-4016-9142-4a9d2fda34a7] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:41.976856 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:28:41.987627 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e0bcbbb5-b323-487e-8c83-58fae0915d1a tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:41.988091 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e0bcbbb5-b323-487e-8c83-58fae0915d1a tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:41.988868 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e0bcbbb5-b323-487e-8c83-58fae0915d1a tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:41.989309 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e0bcbbb5-b323-487e-8c83-58fae0915d1a tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:42.010597 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.wsgi [None req-e0bcbbb5-b323-487e-8c83-58fae0915d1a tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] HTTP exception thrown: Instance fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 could not be found. Jul 31 14:28:42.012573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-e0bcbbb5-b323-487e-8c83-58fae0915d1a tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Request method failure captured: Jul 31 14:28:42.012573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: request: GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 HTTP/1.1 Jul 31 14:28:42.012573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept: application/json Jul 31 14:28:42.012573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept-Encoding: identity Jul 31 14:28:42.012573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Connection: close Jul 31 14:28:42.012573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Length: 0 Jul 31 14:28:42.012573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Type: application/json Jul 31 14:28:42.012573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Host: 10.222.0.40 Jul 31 14:28:42.012573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Openstack-System-Scope: None Jul 31 14:28:42.012573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: User-Agent: python-urllib3/1.26.10 Jul 31 14:28:42.012573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Auth-Token: gAAAAABi5pECUxelprg8xHeybtTtOuIJiu8dsW7ulHEByBnV4JwOQuGTiA-74HwtOD95Bvi8AYEbgfX7zHoeIOD90V59NZKPUFwh3dIBXWiSrkZhOIFbJbUiDCwvUrvrrQdmEDF2rKZQapGSp7DrCHJEk8tyKs1tcXuiyK8uA8PZHgaFtCRQJbE Jul 31 14:28:42.012573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Id: None Jul 31 14:28:42.012573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Name: None Jul 31 14:28:42.012573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Identity-Status: Confirmed Jul 31 14:28:42.012573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Is-Admin-Project: True Jul 31 14:28:42.012573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Id: default Jul 31 14:28:42.012573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Name: Default Jul 31 14:28:42.012573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Id: ea0d7081bf384d098fad20ef507f4dfd Jul 31 14:28:42.012573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Name: tempest-TestMinimumBasicScenario-1515215193 Jul 31 14:28:42.012573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Role: reader,member Jul 31 14:28:42.012573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Roles: reader,member Jul 31 14:28:42.014185 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea0d7081bf384d098fad20ef507f4dfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ea0d7081bf384d098fad20ef507f4dfd", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ea0d7081bf384d098fad20ef507f4dfd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ea0d7081bf384d098fad20ef507f4dfd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:28:42.014185 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant: tempest-TestMinimumBasicScenario-1515215193 Jul 31 14:28:42.014185 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Id: ea0d7081bf384d098fad20ef507f4dfd Jul 31 14:28:42.014185 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1515215193 Jul 31 14:28:42.014185 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User: tempest-TestMinimumBasicScenario-1515215193-project Jul 31 14:28:42.014185 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Id: default Jul 31 14:28:42.014185 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Name: Default Jul 31 14:28:42.014185 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Id: 3b003c297b914cb08f737b1f4d40b16d Jul 31 14:28:42.014185 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Name: tempest-TestMinimumBasicScenario-1515215193-project Jul 31 14:28:42.014185 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: method: > Jul 31 14:28:42.014185 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: exception: Instance fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 could not be found. Jul 31 14:28:42.014185 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: action_args: {'id': 'fb0fe7f8-51ab-4016-9142-4a9d2fda34a7'} Jul 31 14:28:42.015066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:28:42.015066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:28:42.015066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:28:42.015066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:28:42.015066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:28:42.015066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:28:42.015066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:28:42.015066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:28:42.015066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:28:42.015066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:28:42.015066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 could not be found. Jul 31 14:28:42.015066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:28:42.015066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:28:42.015066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:28:42.015066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:28:42.015066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:28:42.015066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:28:42.015066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:28:42.015066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:28:42.015066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:28:42.016593 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:28:42.016593 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:28:42.016593 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:28:42.016593 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:28:42.016593 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:28:42.016593 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:28:42.016593 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:28:42.016593 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 could not be found. Jul 31 14:28:42.016593 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:28:42.016593 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:28:42.016593 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:28:42.016593 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:28:42.016593 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:28:42.016593 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:28:42.016593 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:28:42.016593 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:28:42.016593 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 could not be found. Jul 31 14:28:42.016593 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:28:42.019332 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-e0bcbbb5-b323-487e-8c83-58fae0915d1a tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Returning 404 to user: Instance fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 could not be found. {{(pid=117781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:28:42.020439 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-e0bcbbb5-b323-487e-8c83-58fae0915d1a tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7" status: 404 len: 111 microversion: 2.1 time: 0.052270 Jul 31 14:28:42.029357 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-06dbcd03-6847-472e-8378-02934ef307e0 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] Calling method '.version_select at 0x7f87e97e8430>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:42.035022 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 388/798] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:28:41 2022] GET /compute/v2.1/servers/fb0fe7f8-51ab-4016-9142-4a9d2fda34a7 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:28:42.058329 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-06dbcd03-6847-472e-8378-02934ef307e0 tempest-TestMinimumBasicScenario-1515215193 tempest-TestMinimumBasicScenario-1515215193-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-738499298" status: 202 len: 0 microversion: 2.1 time: 0.032541 Jul 31 14:28:42.059196 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 411/799] 10.222.0.40 () {58 vars in 1269 bytes} [Sun Jul 31 14:28:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-738499298 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 14:28:42.607678 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-c6971f40-eea6-4af2-ad00-040937628ecd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:42.608617 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-c6971f40-eea6-4af2-ad00-040937628ecd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:42.617025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c6971f40-eea6-4af2-ad00-040937628ecd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:42.617705 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c6971f40-eea6-4af2-ad00-040937628ecd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:42.618694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c6971f40-eea6-4af2-ad00-040937628ecd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:42.619492 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c6971f40-eea6-4af2-ad00-040937628ecd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:42.855158 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c6971f40-eea6-4af2-ad00-040937628ecd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:42.871479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c6971f40-eea6-4af2-ad00-040937628ecd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:42.874231 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c6971f40-eea6-4af2-ad00-040937628ecd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:42.875871 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-c6971f40-eea6-4af2-ad00-040937628ecd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1741 microversion: 2.20 time: 0.274362 Jul 31 14:28:42.877016 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 389/800] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:42 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1741 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:43.901335 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fb5088ed-727d-464e-98db-85c474c9a205 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:43.902297 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fb5088ed-727d-464e-98db-85c474c9a205 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:43.918377 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fb5088ed-727d-464e-98db-85c474c9a205 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:43.918826 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fb5088ed-727d-464e-98db-85c474c9a205 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:43.919681 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fb5088ed-727d-464e-98db-85c474c9a205 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:43.920119 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fb5088ed-727d-464e-98db-85c474c9a205 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:44.165310 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fb5088ed-727d-464e-98db-85c474c9a205 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:44.179501 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fb5088ed-727d-464e-98db-85c474c9a205 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:44.181640 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fb5088ed-727d-464e-98db-85c474c9a205 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:44.183625 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fb5088ed-727d-464e-98db-85c474c9a205 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1741 microversion: 2.20 time: 0.286413 Jul 31 14:28:44.184552 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 412/801] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:43 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1741 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:45.210654 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-054fa860-7e69-4a50-baa0-2cd8195b8c86 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:45.211636 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-054fa860-7e69-4a50-baa0-2cd8195b8c86 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:45.219785 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-054fa860-7e69-4a50-baa0-2cd8195b8c86 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:45.220779 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-054fa860-7e69-4a50-baa0-2cd8195b8c86 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:45.222269 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-054fa860-7e69-4a50-baa0-2cd8195b8c86 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:45.223060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-054fa860-7e69-4a50-baa0-2cd8195b8c86 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:45.420188 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-054fa860-7e69-4a50-baa0-2cd8195b8c86 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:45.434225 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-054fa860-7e69-4a50-baa0-2cd8195b8c86 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:45.436816 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-054fa860-7e69-4a50-baa0-2cd8195b8c86 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:45.439499 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-054fa860-7e69-4a50-baa0-2cd8195b8c86 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1741 microversion: 2.20 time: 0.232976 Jul 31 14:28:45.441527 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 390/802] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:45 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1741 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:46.466811 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0efc9f25-9687-421c-9a49-cdb507fa7fdb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:46.467708 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0efc9f25-9687-421c-9a49-cdb507fa7fdb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:46.478747 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0efc9f25-9687-421c-9a49-cdb507fa7fdb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:46.479201 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0efc9f25-9687-421c-9a49-cdb507fa7fdb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:46.480104 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0efc9f25-9687-421c-9a49-cdb507fa7fdb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:46.480555 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0efc9f25-9687-421c-9a49-cdb507fa7fdb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:46.716404 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0efc9f25-9687-421c-9a49-cdb507fa7fdb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:46.738150 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0efc9f25-9687-421c-9a49-cdb507fa7fdb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:46.739712 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0efc9f25-9687-421c-9a49-cdb507fa7fdb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:46.741475 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0efc9f25-9687-421c-9a49-cdb507fa7fdb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1723 microversion: 2.20 time: 0.279417 Jul 31 14:28:46.742367 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 413/803] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:46 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:47.765593 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b9dd4cc3-c9ad-4a20-bc27-eaeeba3be4f7 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:47.766194 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b9dd4cc3-c9ad-4a20-bc27-eaeeba3be4f7 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:47.773381 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b9dd4cc3-c9ad-4a20-bc27-eaeeba3be4f7 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:47.773825 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b9dd4cc3-c9ad-4a20-bc27-eaeeba3be4f7 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:47.774705 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b9dd4cc3-c9ad-4a20-bc27-eaeeba3be4f7 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:47.775011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b9dd4cc3-c9ad-4a20-bc27-eaeeba3be4f7 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:48.012010 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b9dd4cc3-c9ad-4a20-bc27-eaeeba3be4f7 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:48.031736 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b9dd4cc3-c9ad-4a20-bc27-eaeeba3be4f7 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:48.036531 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b9dd4cc3-c9ad-4a20-bc27-eaeeba3be4f7 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:48.041272 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b9dd4cc3-c9ad-4a20-bc27-eaeeba3be4f7 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1723 microversion: 2.20 time: 0.279494 Jul 31 14:28:48.054446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 391/804] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:47 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:48.594595 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-81cdd8fa-a39c-490b-9a2a-856390dc5ff4 req-16570ac1-7ba7-4130-8896-e21a2130ebcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6200d587-a817-4a77-b242-ec578e8e57dc", "name": "network-vif-unplugged", "status": "completed", "tag": "414cf0f9-b0cd-4363-9160-1242693140a5"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:28:48.623910 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-81cdd8fa-a39c-490b-9a2a-856390dc5ff4 req-16570ac1-7ba7-4130-8896-e21a2130ebcf service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:48.624724 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-81cdd8fa-a39c-490b-9a2a-856390dc5ff4 req-16570ac1-7ba7-4130-8896-e21a2130ebcf service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:48.648514 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-81cdd8fa-a39c-490b-9a2a-856390dc5ff4 req-16570ac1-7ba7-4130-8896-e21a2130ebcf service nova] Creating event network-vif-unplugged:414cf0f9-b0cd-4363-9160-1242693140a5 for instance 6200d587-a817-4a77-b242-ec578e8e57dc on hv-cinder-84984 Jul 31 14:28:48.666829 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-81cdd8fa-a39c-490b-9a2a-856390dc5ff4 req-16570ac1-7ba7-4130-8896-e21a2130ebcf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076428 Jul 31 14:28:48.668600 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 414/805] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:28:49.066828 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-90e2da44-00e8-401d-89cd-7b5f91cc77d0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:49.068301 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-90e2da44-00e8-401d-89cd-7b5f91cc77d0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:49.075911 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-90e2da44-00e8-401d-89cd-7b5f91cc77d0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:49.076583 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-90e2da44-00e8-401d-89cd-7b5f91cc77d0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:49.077517 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-90e2da44-00e8-401d-89cd-7b5f91cc77d0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:49.078110 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-90e2da44-00e8-401d-89cd-7b5f91cc77d0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:49.344587 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-90e2da44-00e8-401d-89cd-7b5f91cc77d0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:49.353311 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-90e2da44-00e8-401d-89cd-7b5f91cc77d0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:49.355017 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-90e2da44-00e8-401d-89cd-7b5f91cc77d0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:49.356348 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-90e2da44-00e8-401d-89cd-7b5f91cc77d0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1666 microversion: 2.20 time: 0.295015 Jul 31 14:28:49.357021 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 392/806] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:49 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1666 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:49.380046 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4d66fb9d-2f75-431d-8317-c31a60498b6a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3dd327b6-736f-4ab6-ad6f-f34dda7410d6"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:28:49.382442 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4d66fb9d-2f75-431d-8317-c31a60498b6a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:49.389490 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4d66fb9d-2f75-431d-8317-c31a60498b6a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:49.390197 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4d66fb9d-2f75-431d-8317-c31a60498b6a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:49.391014 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4d66fb9d-2f75-431d-8317-c31a60498b6a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:49.391679 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4d66fb9d-2f75-431d-8317-c31a60498b6a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:49.479978 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=100 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:28:49.705966 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4d66fb9d-2f75-431d-8317-c31a60498b6a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "POST /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.330369 Jul 31 14:28:49.707011 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 415/807] 10.222.0.40 () {62 vars in 1364 bytes} [Sun Jul 31 14:28:49 2022] POST /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc/os-volume_attachments => generated 188 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 31 14:28:49.831458 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-d7ea8923-d523-42b5-9206-38484b6c10c1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:49.831974 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-d7ea8923-d523-42b5-9206-38484b6c10c1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:49.838063 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d7ea8923-d523-42b5-9206-38484b6c10c1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:49.838516 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d7ea8923-d523-42b5-9206-38484b6c10c1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:49.839322 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d7ea8923-d523-42b5-9206-38484b6c10c1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:49.839807 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d7ea8923-d523-42b5-9206-38484b6c10c1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:49.857589 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:28:50.161868 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-d7ea8923-d523-42b5-9206-38484b6c10c1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc/os-volume_attachments/3dd327b6-736f-4ab6-ad6f-f34dda7410d6" status: 202 len: 0 microversion: 2.20 time: 0.334340 Jul 31 14:28:50.162634 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 393/808] 10.222.0.40 () {60 vars in 1457 bytes} [Sun Jul 31 14:28:49 2022] DELETE /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc/os-volume_attachments/3dd327b6-736f-4ab6-ad6f-f34dda7410d6 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 14:28:50.229337 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e1510a64-88b2-4d85-be7f-575d11a52b84 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:28:50.229940 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e1510a64-88b2-4d85-be7f-575d11a52b84 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:50.236270 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e1510a64-88b2-4d85-be7f-575d11a52b84 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:50.236632 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e1510a64-88b2-4d85-be7f-575d11a52b84 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:50.237422 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e1510a64-88b2-4d85-be7f-575d11a52b84 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:50.237862 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e1510a64-88b2-4d85-be7f-575d11a52b84 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:50.272699 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e1510a64-88b2-4d85-be7f-575d11a52b84 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117780) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 31 14:28:50.373619 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e1510a64-88b2-4d85-be7f-575d11a52b84 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "POST /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc/action" status: 202 len: 0 microversion: 2.20 time: 0.148157 Jul 31 14:28:50.378166 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 416/809] 10.222.0.40 () {62 vars in 1319 bytes} [Sun Jul 31 14:28:50 2022] POST /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 31 14:28:50.383599 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-2b9b7ff4-3bbe-4250-a1f4-0a45657ea547 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:50.384207 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-2b9b7ff4-3bbe-4250-a1f4-0a45657ea547 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:50.392175 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2b9b7ff4-3bbe-4250-a1f4-0a45657ea547 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:50.392963 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2b9b7ff4-3bbe-4250-a1f4-0a45657ea547 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:50.393913 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2b9b7ff4-3bbe-4250-a1f4-0a45657ea547 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:50.394514 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2b9b7ff4-3bbe-4250-a1f4-0a45657ea547 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:50.613083 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-2b9b7ff4-3bbe-4250-a1f4-0a45657ea547 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:50.622073 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-2b9b7ff4-3bbe-4250-a1f4-0a45657ea547 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:50.628110 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-2b9b7ff4-3bbe-4250-a1f4-0a45657ea547 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:50.629351 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-2b9b7ff4-3bbe-4250-a1f4-0a45657ea547 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1674 microversion: 2.20 time: 0.249695 Jul 31 14:28:50.631235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 394/810] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:50 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1674 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:51.653360 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4b24fbc1-8b3c-4dec-9074-e116258bf726 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:51.653981 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4b24fbc1-8b3c-4dec-9074-e116258bf726 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:51.660836 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4b24fbc1-8b3c-4dec-9074-e116258bf726 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:51.661290 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4b24fbc1-8b3c-4dec-9074-e116258bf726 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:51.662063 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4b24fbc1-8b3c-4dec-9074-e116258bf726 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:51.662506 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4b24fbc1-8b3c-4dec-9074-e116258bf726 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:51.803856 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4b24fbc1-8b3c-4dec-9074-e116258bf726 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:51.812514 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4b24fbc1-8b3c-4dec-9074-e116258bf726 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:51.814025 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4b24fbc1-8b3c-4dec-9074-e116258bf726 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:51.815741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4b24fbc1-8b3c-4dec-9074-e116258bf726 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1732 microversion: 2.20 time: 0.166305 Jul 31 14:28:51.816302 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 417/811] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:51 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:52.843661 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-6e177d94-95c6-4fed-b409-d9f039194918 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:52.845174 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-6e177d94-95c6-4fed-b409-d9f039194918 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:52.852728 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6e177d94-95c6-4fed-b409-d9f039194918 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:52.853650 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6e177d94-95c6-4fed-b409-d9f039194918 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:52.854436 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6e177d94-95c6-4fed-b409-d9f039194918 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:52.854877 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6e177d94-95c6-4fed-b409-d9f039194918 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:53.100965 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-6e177d94-95c6-4fed-b409-d9f039194918 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:53.110060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-6e177d94-95c6-4fed-b409-d9f039194918 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:53.112257 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-6e177d94-95c6-4fed-b409-d9f039194918 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:53.113531 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-6e177d94-95c6-4fed-b409-d9f039194918 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1732 microversion: 2.20 time: 0.276850 Jul 31 14:28:53.114171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 395/812] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:52 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1732 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:54.138331 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7a64e11d-3a87-4cfa-ae9b-8ce53fac4771 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:54.139646 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7a64e11d-3a87-4cfa-ae9b-8ce53fac4771 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:54.147469 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7a64e11d-3a87-4cfa-ae9b-8ce53fac4771 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:54.148155 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7a64e11d-3a87-4cfa-ae9b-8ce53fac4771 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:54.149153 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7a64e11d-3a87-4cfa-ae9b-8ce53fac4771 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:54.149805 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7a64e11d-3a87-4cfa-ae9b-8ce53fac4771 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:54.300425 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7a64e11d-3a87-4cfa-ae9b-8ce53fac4771 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:54.310904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7a64e11d-3a87-4cfa-ae9b-8ce53fac4771 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:54.312838 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7a64e11d-3a87-4cfa-ae9b-8ce53fac4771 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:54.314243 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7a64e11d-3a87-4cfa-ae9b-8ce53fac4771 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1732 microversion: 2.20 time: 0.179966 Jul 31 14:28:54.331281 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 418/813] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:54 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:55.338201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-c1027f8e-db77-4efa-a687-d282558988b0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:55.338818 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-c1027f8e-db77-4efa-a687-d282558988b0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:55.345590 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c1027f8e-db77-4efa-a687-d282558988b0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:55.346133 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c1027f8e-db77-4efa-a687-d282558988b0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:55.346891 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c1027f8e-db77-4efa-a687-d282558988b0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:55.347335 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c1027f8e-db77-4efa-a687-d282558988b0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:55.500530 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c1027f8e-db77-4efa-a687-d282558988b0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:55.509270 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c1027f8e-db77-4efa-a687-d282558988b0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:55.510860 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c1027f8e-db77-4efa-a687-d282558988b0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:55.512100 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-c1027f8e-db77-4efa-a687-d282558988b0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1732 microversion: 2.20 time: 0.177832 Jul 31 14:28:55.512675 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 396/814] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:55 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:56.536961 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1cd14ee4-0023-462a-b0e9-506cce7b32b1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:56.537574 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1cd14ee4-0023-462a-b0e9-506cce7b32b1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:56.544216 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1cd14ee4-0023-462a-b0e9-506cce7b32b1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:56.544701 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1cd14ee4-0023-462a-b0e9-506cce7b32b1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:56.545480 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1cd14ee4-0023-462a-b0e9-506cce7b32b1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:56.546114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1cd14ee4-0023-462a-b0e9-506cce7b32b1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:56.682230 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1cd14ee4-0023-462a-b0e9-506cce7b32b1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:56.691010 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1cd14ee4-0023-462a-b0e9-506cce7b32b1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:56.692572 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1cd14ee4-0023-462a-b0e9-506cce7b32b1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:56.693874 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1cd14ee4-0023-462a-b0e9-506cce7b32b1 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1732 microversion: 2.20 time: 0.161505 Jul 31 14:28:56.694454 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 419/815] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:56 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:57.718071 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b678bf4a-1da8-472a-8919-8a576cfa6b69 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:57.718679 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b678bf4a-1da8-472a-8919-8a576cfa6b69 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:57.725761 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b678bf4a-1da8-472a-8919-8a576cfa6b69 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:57.726210 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b678bf4a-1da8-472a-8919-8a576cfa6b69 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:57.726973 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b678bf4a-1da8-472a-8919-8a576cfa6b69 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:57.727411 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b678bf4a-1da8-472a-8919-8a576cfa6b69 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:57.861778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b678bf4a-1da8-472a-8919-8a576cfa6b69 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:57.873967 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b678bf4a-1da8-472a-8919-8a576cfa6b69 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:57.875699 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b678bf4a-1da8-472a-8919-8a576cfa6b69 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:57.879442 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b678bf4a-1da8-472a-8919-8a576cfa6b69 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1732 microversion: 2.20 time: 0.165227 Jul 31 14:28:57.880235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 397/816] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:57 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:28:58.903899 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-dfdef0f2-1d99-477b-8633-ac7635660753 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:28:58.904595 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-dfdef0f2-1d99-477b-8633-ac7635660753 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:28:58.911704 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dfdef0f2-1d99-477b-8633-ac7635660753 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:58.912156 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dfdef0f2-1d99-477b-8633-ac7635660753 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:58.912939 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dfdef0f2-1d99-477b-8633-ac7635660753 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:28:58.913547 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-dfdef0f2-1d99-477b-8633-ac7635660753 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:28:59.050993 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-dfdef0f2-1d99-477b-8633-ac7635660753 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:59.060428 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-dfdef0f2-1d99-477b-8633-ac7635660753 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:59.061929 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-dfdef0f2-1d99-477b-8633-ac7635660753 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:28:59.063098 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-dfdef0f2-1d99-477b-8633-ac7635660753 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1732 microversion: 2.20 time: 0.163564 Jul 31 14:28:59.063906 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 420/817] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:28:58 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:29:00.087044 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-5c071d67-0ea1-4564-9668-5b10d90735ac tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:00.087913 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-5c071d67-0ea1-4564-9668-5b10d90735ac tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:00.094656 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5c071d67-0ea1-4564-9668-5b10d90735ac tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:00.095106 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5c071d67-0ea1-4564-9668-5b10d90735ac tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:00.095958 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5c071d67-0ea1-4564-9668-5b10d90735ac tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:00.096394 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5c071d67-0ea1-4564-9668-5b10d90735ac tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:00.242685 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-5c071d67-0ea1-4564-9668-5b10d90735ac tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:00.252850 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-5c071d67-0ea1-4564-9668-5b10d90735ac tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:00.255749 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-5c071d67-0ea1-4564-9668-5b10d90735ac tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:00.257684 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-5c071d67-0ea1-4564-9668-5b10d90735ac tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1732 microversion: 2.20 time: 0.174559 Jul 31 14:29:00.258256 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 398/818] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:29:00 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:29:01.281487 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3a05893f-6c73-4dea-8f85-9a69a6417bf0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:01.282100 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3a05893f-6c73-4dea-8f85-9a69a6417bf0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:01.288839 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3a05893f-6c73-4dea-8f85-9a69a6417bf0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:01.289290 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3a05893f-6c73-4dea-8f85-9a69a6417bf0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:01.290061 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3a05893f-6c73-4dea-8f85-9a69a6417bf0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:01.290506 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3a05893f-6c73-4dea-8f85-9a69a6417bf0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:01.432684 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3a05893f-6c73-4dea-8f85-9a69a6417bf0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:01.441801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3a05893f-6c73-4dea-8f85-9a69a6417bf0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:01.443448 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3a05893f-6c73-4dea-8f85-9a69a6417bf0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:01.444632 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3a05893f-6c73-4dea-8f85-9a69a6417bf0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1732 microversion: 2.20 time: 0.167085 Jul 31 14:29:01.445201 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 421/819] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:29:01 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:29:02.469252 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-a5ce20f3-048d-4a9f-861a-110c7f0672b4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:02.469876 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-a5ce20f3-048d-4a9f-861a-110c7f0672b4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:02.477203 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a5ce20f3-048d-4a9f-861a-110c7f0672b4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:02.477644 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a5ce20f3-048d-4a9f-861a-110c7f0672b4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:02.478401 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a5ce20f3-048d-4a9f-861a-110c7f0672b4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:02.478833 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a5ce20f3-048d-4a9f-861a-110c7f0672b4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:02.605685 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a5ce20f3-048d-4a9f-861a-110c7f0672b4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:02.614113 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a5ce20f3-048d-4a9f-861a-110c7f0672b4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:02.618317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a5ce20f3-048d-4a9f-861a-110c7f0672b4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:02.618317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-a5ce20f3-048d-4a9f-861a-110c7f0672b4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1732 microversion: 2.20 time: 0.151346 Jul 31 14:29:02.618317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 399/820] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:29:02 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:29:02.911752 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-eb93034a-6ca3-411f-98c0-4202f8da1095 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:02.912360 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-eb93034a-6ca3-411f-98c0-4202f8da1095 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:02.915712 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:29:02.920818 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-eb93034a-6ca3-411f-98c0-4202f8da1095 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:02.921268 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-eb93034a-6ca3-411f-98c0-4202f8da1095 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:02.922050 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-eb93034a-6ca3-411f-98c0-4202f8da1095 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:02.922485 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-eb93034a-6ca3-411f-98c0-4202f8da1095 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:02.949015 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-eb93034a-6ca3-411f-98c0-4202f8da1095 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd/ips" status: 200 len: 151 microversion: 2.1 time: 0.041257 Jul 31 14:29:02.949781 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 422/821] 10.222.0.40 () {58 vars in 1248 bytes} [Sun Jul 31 14:29:02 2022] GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:29:03.639962 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-dfc0f618-43dd-4c85-be2a-af1f49477b1a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:03.640730 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-dfc0f618-43dd-4c85-be2a-af1f49477b1a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:03.647818 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dfc0f618-43dd-4c85-be2a-af1f49477b1a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:03.648275 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dfc0f618-43dd-4c85-be2a-af1f49477b1a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:03.649039 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dfc0f618-43dd-4c85-be2a-af1f49477b1a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:03.649481 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dfc0f618-43dd-4c85-be2a-af1f49477b1a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:03.781169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-dfc0f618-43dd-4c85-be2a-af1f49477b1a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:03.789559 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-dfc0f618-43dd-4c85-be2a-af1f49477b1a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:03.791073 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-dfc0f618-43dd-4c85-be2a-af1f49477b1a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:03.792256 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-dfc0f618-43dd-4c85-be2a-af1f49477b1a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1732 microversion: 2.20 time: 0.156453 Jul 31 14:29:03.792820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 400/822] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:29:03 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:29:04.283003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9366e6a4-3beb-4634-a454-a210498ef557 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa2e2720-390b-44d0-a3bd-adbd4f7c69a2"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:29:04.285444 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9366e6a4-3beb-4634-a454-a210498ef557 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:04.292072 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9366e6a4-3beb-4634-a454-a210498ef557 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:04.292520 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9366e6a4-3beb-4634-a454-a210498ef557 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:04.293273 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9366e6a4-3beb-4634-a454-a210498ef557 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:04.293705 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9366e6a4-3beb-4634-a454-a210498ef557 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:04.540397 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9366e6a4-3beb-4634-a454-a210498ef557 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "POST /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261251 Jul 31 14:29:04.540984 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 423/823] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Jul 31 14:29:04 2022] POST /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:29:04.816042 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-12688bc9-1112-4347-8ab7-fe5e5447601b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:04.816673 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-12688bc9-1112-4347-8ab7-fe5e5447601b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:04.823082 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-12688bc9-1112-4347-8ab7-fe5e5447601b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:04.823571 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-12688bc9-1112-4347-8ab7-fe5e5447601b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:04.824330 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-12688bc9-1112-4347-8ab7-fe5e5447601b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:04.824767 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-12688bc9-1112-4347-8ab7-fe5e5447601b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:04.954311 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-12688bc9-1112-4347-8ab7-fe5e5447601b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:04.962219 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-12688bc9-1112-4347-8ab7-fe5e5447601b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:04.963762 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-12688bc9-1112-4347-8ab7-fe5e5447601b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:04.964920 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-12688bc9-1112-4347-8ab7-fe5e5447601b tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1732 microversion: 2.20 time: 0.153321 Jul 31 14:29:04.965479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 401/824] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:29:04 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:29:05.989522 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-08f42426-f0e7-44ee-8c33-883c042ae1dd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:05.990254 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-08f42426-f0e7-44ee-8c33-883c042ae1dd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:05.996519 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-08f42426-f0e7-44ee-8c33-883c042ae1dd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:05.996970 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-08f42426-f0e7-44ee-8c33-883c042ae1dd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:05.997735 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-08f42426-f0e7-44ee-8c33-883c042ae1dd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:05.998174 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-08f42426-f0e7-44ee-8c33-883c042ae1dd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:06.129854 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-08f42426-f0e7-44ee-8c33-883c042ae1dd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:06.137750 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-08f42426-f0e7-44ee-8c33-883c042ae1dd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:06.139258 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-08f42426-f0e7-44ee-8c33-883c042ae1dd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:06.140458 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-08f42426-f0e7-44ee-8c33-883c042ae1dd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1732 microversion: 2.20 time: 0.155654 Jul 31 14:29:06.141019 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 424/825] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:29:05 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:29:07.164167 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-a59b37a4-7b0d-465d-bb39-e289f25dc363 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:07.164783 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-a59b37a4-7b0d-465d-bb39-e289f25dc363 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:07.170865 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a59b37a4-7b0d-465d-bb39-e289f25dc363 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:07.171323 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a59b37a4-7b0d-465d-bb39-e289f25dc363 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:07.172124 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a59b37a4-7b0d-465d-bb39-e289f25dc363 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:07.172562 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a59b37a4-7b0d-465d-bb39-e289f25dc363 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:07.296591 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a59b37a4-7b0d-465d-bb39-e289f25dc363 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:07.304487 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a59b37a4-7b0d-465d-bb39-e289f25dc363 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:07.306009 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a59b37a4-7b0d-465d-bb39-e289f25dc363 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:07.307163 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-a59b37a4-7b0d-465d-bb39-e289f25dc363 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1732 microversion: 2.20 time: 0.147114 Jul 31 14:29:07.307758 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 402/826] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:29:07 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1732 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:29:08.331039 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a8203fbb-949b-410a-8ab4-a275c6a47ba3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:08.331600 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a8203fbb-949b-410a-8ab4-a275c6a47ba3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:08.338160 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a8203fbb-949b-410a-8ab4-a275c6a47ba3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:08.338610 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a8203fbb-949b-410a-8ab4-a275c6a47ba3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:08.339368 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a8203fbb-949b-410a-8ab4-a275c6a47ba3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:08.339830 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a8203fbb-949b-410a-8ab4-a275c6a47ba3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:08.464800 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a8203fbb-949b-410a-8ab4-a275c6a47ba3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:08.473273 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a8203fbb-949b-410a-8ab4-a275c6a47ba3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:08.474814 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a8203fbb-949b-410a-8ab4-a275c6a47ba3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:08.483241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a8203fbb-949b-410a-8ab4-a275c6a47ba3 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1732 microversion: 2.20 time: 0.149485 Jul 31 14:29:08.483865 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 425/827] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:29:08 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:29:08.631265 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-3c6b0550-2928-44d3-860f-1389db29fddb req-8289aa79-e166-4828-9b7b-2c7686d575b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6200d587-a817-4a77-b242-ec578e8e57dc", "name": "network-vif-plugged", "status": "completed", "tag": "414cf0f9-b0cd-4363-9160-1242693140a5"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:29:08.641600 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-3c6b0550-2928-44d3-860f-1389db29fddb req-8289aa79-e166-4828-9b7b-2c7686d575b0 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:08.642554 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-3c6b0550-2928-44d3-860f-1389db29fddb req-8289aa79-e166-4828-9b7b-2c7686d575b0 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:08.654226 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-3c6b0550-2928-44d3-860f-1389db29fddb req-8289aa79-e166-4828-9b7b-2c7686d575b0 service nova] Creating event network-vif-plugged:414cf0f9-b0cd-4363-9160-1242693140a5 for instance 6200d587-a817-4a77-b242-ec578e8e57dc on hv-cinder-84984 Jul 31 14:29:08.659905 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-3c6b0550-2928-44d3-860f-1389db29fddb req-8289aa79-e166-4828-9b7b-2c7686d575b0 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032259 Jul 31 14:29:08.660518 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 403/828] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:29:09.506774 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8d3ef40e-d389-4fd5-921e-531af238c629 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:09.507320 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8d3ef40e-d389-4fd5-921e-531af238c629 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:09.513830 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8d3ef40e-d389-4fd5-921e-531af238c629 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:09.514282 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8d3ef40e-d389-4fd5-921e-531af238c629 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:09.515054 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8d3ef40e-d389-4fd5-921e-531af238c629 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:09.515520 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8d3ef40e-d389-4fd5-921e-531af238c629 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:09.649542 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8d3ef40e-d389-4fd5-921e-531af238c629 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:09.657969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8d3ef40e-d389-4fd5-921e-531af238c629 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:09.659529 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8d3ef40e-d389-4fd5-921e-531af238c629 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:09.660698 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8d3ef40e-d389-4fd5-921e-531af238c629 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1732 microversion: 2.20 time: 0.157969 Jul 31 14:29:09.661269 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 426/829] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:29:09 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:29:10.684373 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-cf10a8bc-4cea-4412-9111-9ae876bf35cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:10.685028 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-cf10a8bc-4cea-4412-9111-9ae876bf35cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:10.692343 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-cf10a8bc-4cea-4412-9111-9ae876bf35cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:10.692793 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-cf10a8bc-4cea-4412-9111-9ae876bf35cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:10.693555 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-cf10a8bc-4cea-4412-9111-9ae876bf35cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:10.693991 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-cf10a8bc-4cea-4412-9111-9ae876bf35cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:10.823430 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-cf10a8bc-4cea-4412-9111-9ae876bf35cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:10.831607 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-cf10a8bc-4cea-4412-9111-9ae876bf35cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:10.834057 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-cf10a8bc-4cea-4412-9111-9ae876bf35cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:10.835267 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-cf10a8bc-4cea-4412-9111-9ae876bf35cd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1732 microversion: 2.20 time: 0.155225 Jul 31 14:29:10.835876 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 404/830] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:29:10 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:29:11.858468 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7704176b-f7ff-4c40-b48b-b561b9e54f81 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:11.859077 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7704176b-f7ff-4c40-b48b-b561b9e54f81 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:11.865599 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7704176b-f7ff-4c40-b48b-b561b9e54f81 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:11.866048 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7704176b-f7ff-4c40-b48b-b561b9e54f81 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:11.866809 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7704176b-f7ff-4c40-b48b-b561b9e54f81 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:11.867248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7704176b-f7ff-4c40-b48b-b561b9e54f81 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:11.994851 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7704176b-f7ff-4c40-b48b-b561b9e54f81 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:11.998338 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:29:12.004521 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7704176b-f7ff-4c40-b48b-b561b9e54f81 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:12.006034 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7704176b-f7ff-4c40-b48b-b561b9e54f81 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:12.007208 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7704176b-f7ff-4c40-b48b-b561b9e54f81 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1719 microversion: 2.20 time: 0.152649 Jul 31 14:29:12.007811 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 427/831] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:29:11 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:29:12.186856 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-3a776db5-4cea-463f-8bf6-3a6d07a3a9bb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:12.187346 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-3a776db5-4cea-463f-8bf6-3a6d07a3a9bb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:12.194234 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3a776db5-4cea-463f-8bf6-3a6d07a3a9bb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:12.194679 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3a776db5-4cea-463f-8bf6-3a6d07a3a9bb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:12.195443 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3a776db5-4cea-463f-8bf6-3a6d07a3a9bb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:12.195898 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3a776db5-4cea-463f-8bf6-3a6d07a3a9bb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:12.273943 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.objects.instance [None req-3a776db5-4cea-463f-8bf6-3a6d07a3a9bb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lazy-loading 'services' on Instance uuid 52d6930f-fac2-4f58-996e-00224187cbbd {{(pid=117781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:29:12.344205 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-3a776db5-4cea-463f-8bf6-3a6d07a3a9bb tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "DELETE /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd/os-volume_attachments/aa2e2720-390b-44d0-a3bd-adbd4f7c69a2" status: 202 len: 0 microversion: 2.1 time: 0.160992 Jul 31 14:29:12.344928 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 405/832] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Jul 31 14:29:12 2022] DELETE /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd/os-volume_attachments/aa2e2720-390b-44d0-a3bd-adbd4f7c69a2 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:29:12.354287 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-33706144-16b5-4b1f-b017-3591e5a1e2d4 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:12.356585 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-33706144-16b5-4b1f-b017-3591e5a1e2d4 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:12.366541 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-33706144-16b5-4b1f-b017-3591e5a1e2d4 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:12.366943 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-33706144-16b5-4b1f-b017-3591e5a1e2d4 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:12.367758 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-33706144-16b5-4b1f-b017-3591e5a1e2d4 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:12.368202 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-33706144-16b5-4b1f-b017-3591e5a1e2d4 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:12.401195 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-33706144-16b5-4b1f-b017-3591e5a1e2d4 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051116 Jul 31 14:29:12.401561 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 428/833] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Jul 31 14:29:12 2022] GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:29:13.413530 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-ae03ddc2-dd51-4cc7-9e55-ef1ce2cc96e2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:13.415927 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-ae03ddc2-dd51-4cc7-9e55-ef1ce2cc96e2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:13.417844 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=36 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:29:13.423450 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ae03ddc2-dd51-4cc7-9e55-ef1ce2cc96e2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:13.423907 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ae03ddc2-dd51-4cc7-9e55-ef1ce2cc96e2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:13.424670 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ae03ddc2-dd51-4cc7-9e55-ef1ce2cc96e2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:13.425112 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ae03ddc2-dd51-4cc7-9e55-ef1ce2cc96e2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:13.453413 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-ae03ddc2-dd51-4cc7-9e55-ef1ce2cc96e2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044733 Jul 31 14:29:13.453964 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 406/834] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Jul 31 14:29:13 2022] GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 14:29:13.514251 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-955cc839-ae34-4b7e-aa77-20eb627b05b7 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:13.514739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-955cc839-ae34-4b7e-aa77-20eb627b05b7 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:13.521841 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-955cc839-ae34-4b7e-aa77-20eb627b05b7 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:13.522288 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-955cc839-ae34-4b7e-aa77-20eb627b05b7 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:13.523049 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-955cc839-ae34-4b7e-aa77-20eb627b05b7 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:13.523511 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-955cc839-ae34-4b7e-aa77-20eb627b05b7 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:13.547549 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-955cc839-ae34-4b7e-aa77-20eb627b05b7 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Going to try to terminate instance {{(pid=117780) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 14:29:13.636275 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-955cc839-ae34-4b7e-aa77-20eb627b05b7 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "DELETE /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd" status: 204 len: 0 microversion: 2.1 time: 0.125520 Jul 31 14:29:13.636857 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 429/835] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:29:13 2022] DELETE /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 14:29:13.645014 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-c47c87b2-c614-4875-b62e-d87300627138 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:13.645649 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-c47c87b2-c614-4875-b62e-d87300627138 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:13.651534 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c47c87b2-c614-4875-b62e-d87300627138 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:13.651975 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c47c87b2-c614-4875-b62e-d87300627138 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:13.652730 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c47c87b2-c614-4875-b62e-d87300627138 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:13.653163 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c47c87b2-c614-4875-b62e-d87300627138 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:13.784119 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c47c87b2-c614-4875-b62e-d87300627138 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:13.786308 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:29:13.793527 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-c47c87b2-c614-4875-b62e-d87300627138 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd" status: 200 len: 1684 microversion: 2.1 time: 0.152414 Jul 31 14:29:13.794131 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 407/836] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:29:13 2022] GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:29:14.814671 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5cc4c7b1-4f37-4b56-b425-e8384c4a55f6 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:14.815877 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-5cc4c7b1-4f37-4b56-b425-e8384c4a55f6 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:14.822345 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5cc4c7b1-4f37-4b56-b425-e8384c4a55f6 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:14.822788 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5cc4c7b1-4f37-4b56-b425-e8384c4a55f6 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:14.823576 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5cc4c7b1-4f37-4b56-b425-e8384c4a55f6 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:14.824006 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5cc4c7b1-4f37-4b56-b425-e8384c4a55f6 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:14.950550 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-5cc4c7b1-4f37-4b56-b425-e8384c4a55f6 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:14.958610 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-5cc4c7b1-4f37-4b56-b425-e8384c4a55f6 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd" status: 200 len: 1684 microversion: 2.1 time: 0.148193 Jul 31 14:29:14.959163 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 430/837] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:29:14 2022] GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:29:15.982807 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-eaed4755-2f07-40a7-8ddf-7dc24f080821 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:15.983443 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-eaed4755-2f07-40a7-8ddf-7dc24f080821 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:15.990664 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eaed4755-2f07-40a7-8ddf-7dc24f080821 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:15.991165 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eaed4755-2f07-40a7-8ddf-7dc24f080821 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:15.991877 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eaed4755-2f07-40a7-8ddf-7dc24f080821 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:15.992304 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eaed4755-2f07-40a7-8ddf-7dc24f080821 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:16.079123 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-eaed4755-2f07-40a7-8ddf-7dc24f080821 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6e8399080a942f1b689fc8c6b42c717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9097fd66951e457ba46812ff17db7501', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:16.087016 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-eaed4755-2f07-40a7-8ddf-7dc24f080821 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd" status: 200 len: 1616 microversion: 2.1 time: 0.108536 Jul 31 14:29:16.087628 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 408/838] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:29:15 2022] GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd => generated 1616 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:29:16.159842 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-4cfaf6a3-92b5-43c5-b575-e3b41fec3371 req-b826ce8b-b575-4717-9fec-f6a914cf392c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d6930f-fac2-4f58-996e-00224187cbbd", "name": "network-vif-deleted", "tag": "cceca3ff-4dba-468b-9a2c-92275cf1a02c"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:29:16.170808 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-4cfaf6a3-92b5-43c5-b575-e3b41fec3371 req-b826ce8b-b575-4717-9fec-f6a914cf392c service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:16.171241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-4cfaf6a3-92b5-43c5-b575-e3b41fec3371 req-b826ce8b-b575-4717-9fec-f6a914cf392c service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:16.183648 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-4cfaf6a3-92b5-43c5-b575-e3b41fec3371 req-b826ce8b-b575-4717-9fec-f6a914cf392c service nova] Creating event network-vif-deleted:cceca3ff-4dba-468b-9a2c-92275cf1a02c for instance 52d6930f-fac2-4f58-996e-00224187cbbd on hv-cinder-84984 Jul 31 14:29:16.189136 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-4cfaf6a3-92b5-43c5-b575-e3b41fec3371 req-b826ce8b-b575-4717-9fec-f6a914cf392c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033584 Jul 31 14:29:16.190962 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 431/839] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:29:17.109793 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-8d6998b8-aadc-473c-8a3b-1376362605c5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:17.110374 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-8d6998b8-aadc-473c-8a3b-1376362605c5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:17.117013 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8d6998b8-aadc-473c-8a3b-1376362605c5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:17.117467 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8d6998b8-aadc-473c-8a3b-1376362605c5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:17.118314 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8d6998b8-aadc-473c-8a3b-1376362605c5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:17.118675 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8d6998b8-aadc-473c-8a3b-1376362605c5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:17.133030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.wsgi [None req-8d6998b8-aadc-473c-8a3b-1376362605c5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] HTTP exception thrown: Instance 52d6930f-fac2-4f58-996e-00224187cbbd could not be found. Jul 31 14:29:17.135227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-8d6998b8-aadc-473c-8a3b-1376362605c5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Request method failure captured: Jul 31 14:29:17.135227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: request: GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd HTTP/1.1 Jul 31 14:29:17.135227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept: application/json Jul 31 14:29:17.135227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept-Encoding: identity Jul 31 14:29:17.135227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Connection: close Jul 31 14:29:17.135227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Length: 0 Jul 31 14:29:17.135227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Type: application/json Jul 31 14:29:17.135227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Host: 10.222.0.40 Jul 31 14:29:17.135227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Openstack-System-Scope: None Jul 31 14:29:17.135227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: User-Agent: python-urllib3/1.26.10 Jul 31 14:29:17.135227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Auth-Token: gAAAAABi5pA3RnV2a-dDWWL-_ZfxXcr4UktgQI-9SWPGN4xUIh3gpaTPpUlCMNWU1g96nJfR_a1KYUrPG43SkpeWWkH3LXQwcjtBN7d_0kQ02fiRqueKY6XZVQNh8gR0_ddCj_gKuHBtsN430P5RXgDqCVuPQ_rcT-N1y6dWBKzFpQGKjlxkqC0 Jul 31 14:29:17.135227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Id: None Jul 31 14:29:17.135227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Name: None Jul 31 14:29:17.135227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Identity-Status: Confirmed Jul 31 14:29:17.135227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Is-Admin-Project: True Jul 31 14:29:17.135227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Id: default Jul 31 14:29:17.135227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Name: Default Jul 31 14:29:17.135227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:29:17.135227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:17.135227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Role: reader,member Jul 31 14:29:17.135227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Roles: reader,member Jul 31 14:29:17.137289 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9097fd66951e457ba46812ff17db7501", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9097fd66951e457ba46812ff17db7501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:29:17.137289 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:17.137289 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:29:17.137289 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:17.137289 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:29:17.137289 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Id: default Jul 31 14:29:17.137289 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Name: Default Jul 31 14:29:17.137289 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Id: d6e8399080a942f1b689fc8c6b42c717 Jul 31 14:29:17.137289 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Name: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:29:17.137289 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: method: > Jul 31 14:29:17.137289 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: exception: Instance 52d6930f-fac2-4f58-996e-00224187cbbd could not be found. Jul 31 14:29:17.137289 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: action_args: {'id': '52d6930f-fac2-4f58-996e-00224187cbbd'} Jul 31 14:29:17.138089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:29:17.138089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:17.138089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:29:17.138089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:29:17.138089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:29:17.138089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:29:17.138089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:29:17.138089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:29:17.138089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:29:17.138089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:29:17.138089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d6930f-fac2-4f58-996e-00224187cbbd could not be found. Jul 31 14:29:17.138089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:17.138089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:17.138089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:17.138089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:17.138089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:17.138089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:17.138089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:29:17.138089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:29:17.138089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:29:17.139364 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:29:17.139364 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:29:17.139364 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:29:17.139364 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:29:17.139364 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:29:17.139364 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:29:17.139364 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:29:17.139364 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d6930f-fac2-4f58-996e-00224187cbbd could not be found. Jul 31 14:29:17.139364 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:17.139364 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:17.139364 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:17.139364 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:17.139364 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:17.139364 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:17.139364 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:29:17.139364 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:29:17.139364 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d6930f-fac2-4f58-996e-00224187cbbd could not be found. Jul 31 14:29:17.139364 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:17.140731 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-8d6998b8-aadc-473c-8a3b-1376362605c5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Returning 404 to user: Instance 52d6930f-fac2-4f58-996e-00224187cbbd could not be found. {{(pid=117781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:29:17.140731 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-8d6998b8-aadc-473c-8a3b-1376362605c5 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd" status: 404 len: 111 microversion: 2.1 time: 0.031697 Jul 31 14:29:17.140731 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 409/840] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:29:17 2022] GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:29:17.147182 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d20ec325-e952-4468-a014-83af0e496316 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '.version_select at 0x7f87e97e84c0>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:17.167281 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d20ec325-e952-4468-a014-83af0e496316 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1531124973" status: 202 len: 0 microversion: 2.1 time: 0.024973 Jul 31 14:29:17.168044 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 432/841] 10.222.0.40 () {58 vars in 1221 bytes} [Sun Jul 31 14:29:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1531124973 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:29:18.913201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-f3debaf3-bd5e-4e16-9607-9b77487d5340 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:18.913692 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-f3debaf3-bd5e-4e16-9607-9b77487d5340 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:18.920196 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f3debaf3-bd5e-4e16-9607-9b77487d5340 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:18.920641 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f3debaf3-bd5e-4e16-9607-9b77487d5340 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:18.921387 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f3debaf3-bd5e-4e16-9607-9b77487d5340 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:18.921816 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f3debaf3-bd5e-4e16-9607-9b77487d5340 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:18.935157 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.wsgi [None req-f3debaf3-bd5e-4e16-9607-9b77487d5340 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] HTTP exception thrown: Instance 52d6930f-fac2-4f58-996e-00224187cbbd could not be found. Jul 31 14:29:18.936694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-f3debaf3-bd5e-4e16-9607-9b77487d5340 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Request method failure captured: Jul 31 14:29:18.936694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: request: DELETE /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd HTTP/1.1 Jul 31 14:29:18.936694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept: application/json Jul 31 14:29:18.936694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept-Encoding: identity Jul 31 14:29:18.936694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Connection: close Jul 31 14:29:18.936694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Length: 0 Jul 31 14:29:18.936694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Type: application/json Jul 31 14:29:18.936694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Host: 10.222.0.40 Jul 31 14:29:18.936694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Openstack-System-Scope: None Jul 31 14:29:18.936694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: User-Agent: python-urllib3/1.26.10 Jul 31 14:29:18.936694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Auth-Token: gAAAAABi5pA3RnV2a-dDWWL-_ZfxXcr4UktgQI-9SWPGN4xUIh3gpaTPpUlCMNWU1g96nJfR_a1KYUrPG43SkpeWWkH3LXQwcjtBN7d_0kQ02fiRqueKY6XZVQNh8gR0_ddCj_gKuHBtsN430P5RXgDqCVuPQ_rcT-N1y6dWBKzFpQGKjlxkqC0 Jul 31 14:29:18.936694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Id: None Jul 31 14:29:18.936694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Name: None Jul 31 14:29:18.936694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Identity-Status: Confirmed Jul 31 14:29:18.936694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Is-Admin-Project: True Jul 31 14:29:18.936694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Id: default Jul 31 14:29:18.936694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Name: Default Jul 31 14:29:18.936694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:29:18.936694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:18.936694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Role: reader,member Jul 31 14:29:18.936694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Roles: reader,member Jul 31 14:29:18.938238 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9097fd66951e457ba46812ff17db7501", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9097fd66951e457ba46812ff17db7501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:29:18.938238 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:18.938238 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:29:18.938238 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:18.938238 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:29:18.938238 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Id: default Jul 31 14:29:18.938238 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Name: Default Jul 31 14:29:18.938238 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Id: d6e8399080a942f1b689fc8c6b42c717 Jul 31 14:29:18.938238 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Name: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:29:18.938238 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: method: > Jul 31 14:29:18.938238 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: exception: Instance 52d6930f-fac2-4f58-996e-00224187cbbd could not be found. Jul 31 14:29:18.938238 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: action_args: {'id': '52d6930f-fac2-4f58-996e-00224187cbbd'} Jul 31 14:29:18.939142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:29:18.939142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:18.939142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:29:18.939142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:29:18.939142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:29:18.939142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:29:18.939142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:29:18.939142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:29:18.939142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:29:18.939142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:29:18.939142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d6930f-fac2-4f58-996e-00224187cbbd could not be found. Jul 31 14:29:18.939142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:18.939142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:18.939142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:18.939142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:18.939142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:18.939142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:18.939142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:29:18.939142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:29:18.939142 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:29:18.941197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:29:18.941197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 14:29:18.941197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 14:29:18.941197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 14:29:18.941197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 14:29:18.941197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:29:18.941197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:29:18.941197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:29:18.941197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:29:18.941197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d6930f-fac2-4f58-996e-00224187cbbd could not be found. Jul 31 14:29:18.941197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:18.941197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:18.941197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:18.941197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:18.941197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:18.941197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:18.941197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:29:18.941197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:29:18.941197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d6930f-fac2-4f58-996e-00224187cbbd could not be found. Jul 31 14:29:18.941197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:18.942581 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-f3debaf3-bd5e-4e16-9607-9b77487d5340 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Returning 404 to user: Instance 52d6930f-fac2-4f58-996e-00224187cbbd could not be found. {{(pid=117781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:29:18.942581 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-f3debaf3-bd5e-4e16-9607-9b77487d5340 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "DELETE /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd" status: 404 len: 111 microversion: 2.1 time: 0.028622 Jul 31 14:29:18.942581 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 410/842] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:29:18 2022] DELETE /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:29:18.947585 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8d12e5c3-512f-4fd8-afaa-bb358bee803d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:18.948322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8d12e5c3-512f-4fd8-afaa-bb358bee803d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: 52d6930f-fac2-4f58-996e-00224187cbbd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:18.955214 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8d12e5c3-512f-4fd8-afaa-bb358bee803d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:18.955697 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8d12e5c3-512f-4fd8-afaa-bb358bee803d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:18.956465 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8d12e5c3-512f-4fd8-afaa-bb358bee803d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:18.956905 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8d12e5c3-512f-4fd8-afaa-bb358bee803d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:18.969627 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-8d12e5c3-512f-4fd8-afaa-bb358bee803d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] HTTP exception thrown: Instance 52d6930f-fac2-4f58-996e-00224187cbbd could not be found. Jul 31 14:29:18.971222 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8d12e5c3-512f-4fd8-afaa-bb358bee803d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Request method failure captured: Jul 31 14:29:18.971222 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd HTTP/1.1 Jul 31 14:29:18.971222 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:29:18.971222 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:29:18.971222 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:29:18.971222 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:29:18.971222 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:29:18.971222 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:29:18.971222 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:29:18.971222 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:29:18.971222 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pA3RnV2a-dDWWL-_ZfxXcr4UktgQI-9SWPGN4xUIh3gpaTPpUlCMNWU1g96nJfR_a1KYUrPG43SkpeWWkH3LXQwcjtBN7d_0kQ02fiRqueKY6XZVQNh8gR0_ddCj_gKuHBtsN430P5RXgDqCVuPQ_rcT-N1y6dWBKzFpQGKjlxkqC0 Jul 31 14:29:18.971222 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:29:18.971222 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:29:18.971222 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:29:18.971222 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:29:18.971222 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:29:18.971222 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:29:18.971222 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:29:18.971222 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:18.971222 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:29:18.971222 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:29:18.972765 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9097fd66951e457ba46812ff17db7501", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9097fd66951e457ba46812ff17db7501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:29:18.972765 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:18.972765 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:29:18.972765 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:18.972765 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:29:18.972765 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:29:18.972765 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:29:18.972765 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: d6e8399080a942f1b689fc8c6b42c717 Jul 31 14:29:18.972765 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:29:18.972765 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:29:18.972765 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance 52d6930f-fac2-4f58-996e-00224187cbbd could not be found. Jul 31 14:29:18.972765 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': '52d6930f-fac2-4f58-996e-00224187cbbd'} Jul 31 14:29:18.973655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:29:18.973655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:18.973655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:29:18.973655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:29:18.973655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:29:18.973655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:29:18.973655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:29:18.973655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:29:18.973655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:29:18.973655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:29:18.973655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d6930f-fac2-4f58-996e-00224187cbbd could not be found. Jul 31 14:29:18.973655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:18.973655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:18.973655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:18.973655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:18.973655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:18.973655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:18.973655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:29:18.973655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:29:18.973655 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:29:18.975057 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:29:18.975057 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:29:18.975057 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:29:18.975057 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:29:18.975057 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:29:18.975057 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:29:18.975057 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:29:18.975057 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d6930f-fac2-4f58-996e-00224187cbbd could not be found. Jul 31 14:29:18.975057 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:18.975057 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:18.975057 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:18.975057 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:18.975057 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:18.975057 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:18.975057 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:29:18.975057 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:29:18.975057 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d6930f-fac2-4f58-996e-00224187cbbd could not be found. Jul 31 14:29:18.975057 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:18.977450 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8d12e5c3-512f-4fd8-afaa-bb358bee803d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Returning 404 to user: Instance 52d6930f-fac2-4f58-996e-00224187cbbd could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:29:18.977450 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8d12e5c3-512f-4fd8-afaa-bb358bee803d tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd" status: 404 len: 111 microversion: 2.1 time: 0.029460 Jul 31 14:29:18.977450 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 433/843] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:29:18 2022] GET /compute/v2.1/servers/52d6930f-fac2-4f58-996e-00224187cbbd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:29:20.108359 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-52bdb744-8ca3-4801-9b95-2a3673d0a961 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:20.108910 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-52bdb744-8ca3-4801-9b95-2a3673d0a961 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:20.115210 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-52bdb744-8ca3-4801-9b95-2a3673d0a961 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:20.115690 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-52bdb744-8ca3-4801-9b95-2a3673d0a961 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:20.116442 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-52bdb744-8ca3-4801-9b95-2a3673d0a961 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:20.116869 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-52bdb744-8ca3-4801-9b95-2a3673d0a961 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:20.130391 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.wsgi [None req-52bdb744-8ca3-4801-9b95-2a3673d0a961 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] HTTP exception thrown: Instance b65263c9-40f6-48e3-9e44-b8654f688d07 could not be found. Jul 31 14:29:20.131934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-52bdb744-8ca3-4801-9b95-2a3673d0a961 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Request method failure captured: Jul 31 14:29:20.131934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: request: DELETE /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 HTTP/1.1 Jul 31 14:29:20.131934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept: application/json Jul 31 14:29:20.131934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept-Encoding: identity Jul 31 14:29:20.131934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Connection: close Jul 31 14:29:20.131934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Length: 0 Jul 31 14:29:20.131934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Type: application/json Jul 31 14:29:20.131934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Host: 10.222.0.40 Jul 31 14:29:20.131934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Openstack-System-Scope: None Jul 31 14:29:20.131934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: User-Agent: python-urllib3/1.26.10 Jul 31 14:29:20.131934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Auth-Token: gAAAAABi5pA3RnV2a-dDWWL-_ZfxXcr4UktgQI-9SWPGN4xUIh3gpaTPpUlCMNWU1g96nJfR_a1KYUrPG43SkpeWWkH3LXQwcjtBN7d_0kQ02fiRqueKY6XZVQNh8gR0_ddCj_gKuHBtsN430P5RXgDqCVuPQ_rcT-N1y6dWBKzFpQGKjlxkqC0 Jul 31 14:29:20.131934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Id: None Jul 31 14:29:20.131934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Name: None Jul 31 14:29:20.131934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Identity-Status: Confirmed Jul 31 14:29:20.131934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Is-Admin-Project: True Jul 31 14:29:20.131934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Id: default Jul 31 14:29:20.131934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Name: Default Jul 31 14:29:20.131934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:29:20.131934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:20.131934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Role: reader,member Jul 31 14:29:20.131934 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Roles: reader,member Jul 31 14:29:20.133476 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9097fd66951e457ba46812ff17db7501", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9097fd66951e457ba46812ff17db7501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:29:20.133476 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:20.133476 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:29:20.133476 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:20.133476 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:29:20.133476 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Id: default Jul 31 14:29:20.133476 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Name: Default Jul 31 14:29:20.133476 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Id: d6e8399080a942f1b689fc8c6b42c717 Jul 31 14:29:20.133476 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Name: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:29:20.133476 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: method: > Jul 31 14:29:20.133476 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: exception: Instance b65263c9-40f6-48e3-9e44-b8654f688d07 could not be found. Jul 31 14:29:20.133476 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: action_args: {'id': 'b65263c9-40f6-48e3-9e44-b8654f688d07'} Jul 31 14:29:20.134341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:29:20.134341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:20.134341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:29:20.134341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:29:20.134341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:29:20.134341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:29:20.134341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:29:20.134341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:29:20.134341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:29:20.134341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:29:20.134341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b65263c9-40f6-48e3-9e44-b8654f688d07 could not be found. Jul 31 14:29:20.134341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:20.134341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:20.134341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:20.134341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:20.134341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:20.134341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:20.134341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:29:20.134341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:29:20.134341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:29:20.135809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:29:20.135809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 14:29:20.135809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 14:29:20.135809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 14:29:20.135809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 14:29:20.135809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:29:20.135809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:29:20.135809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:29:20.135809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:29:20.135809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b65263c9-40f6-48e3-9e44-b8654f688d07 could not be found. Jul 31 14:29:20.135809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:20.135809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:20.135809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:20.135809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:20.135809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:20.135809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:20.135809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:29:20.135809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:29:20.135809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b65263c9-40f6-48e3-9e44-b8654f688d07 could not be found. Jul 31 14:29:20.135809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:20.137270 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-52bdb744-8ca3-4801-9b95-2a3673d0a961 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Returning 404 to user: Instance b65263c9-40f6-48e3-9e44-b8654f688d07 could not be found. {{(pid=117781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:29:20.137270 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-52bdb744-8ca3-4801-9b95-2a3673d0a961 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07" status: 404 len: 111 microversion: 2.1 time: 0.028775 Jul 31 14:29:20.137270 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 411/844] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:29:20 2022] DELETE /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:29:20.141915 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1e70c64e-322f-44e8-8b1f-d62533aec3ad tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:20.142535 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1e70c64e-322f-44e8-8b1f-d62533aec3ad tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: b65263c9-40f6-48e3-9e44-b8654f688d07] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:20.149761 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1e70c64e-322f-44e8-8b1f-d62533aec3ad tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:20.150207 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1e70c64e-322f-44e8-8b1f-d62533aec3ad tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:20.150969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1e70c64e-322f-44e8-8b1f-d62533aec3ad tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:20.151402 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1e70c64e-322f-44e8-8b1f-d62533aec3ad tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:20.164789 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-1e70c64e-322f-44e8-8b1f-d62533aec3ad tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] HTTP exception thrown: Instance b65263c9-40f6-48e3-9e44-b8654f688d07 could not be found. Jul 31 14:29:20.166317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1e70c64e-322f-44e8-8b1f-d62533aec3ad tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Request method failure captured: Jul 31 14:29:20.166317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 HTTP/1.1 Jul 31 14:29:20.166317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:29:20.166317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:29:20.166317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:29:20.166317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:29:20.166317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:29:20.166317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:29:20.166317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:29:20.166317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:29:20.166317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pA3RnV2a-dDWWL-_ZfxXcr4UktgQI-9SWPGN4xUIh3gpaTPpUlCMNWU1g96nJfR_a1KYUrPG43SkpeWWkH3LXQwcjtBN7d_0kQ02fiRqueKY6XZVQNh8gR0_ddCj_gKuHBtsN430P5RXgDqCVuPQ_rcT-N1y6dWBKzFpQGKjlxkqC0 Jul 31 14:29:20.166317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:29:20.166317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:29:20.166317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:29:20.166317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:29:20.166317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:29:20.166317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:29:20.166317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:29:20.166317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:20.166317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:29:20.166317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:29:20.167914 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9097fd66951e457ba46812ff17db7501", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9097fd66951e457ba46812ff17db7501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:29:20.167914 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:20.167914 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:29:20.167914 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:20.167914 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:29:20.167914 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:29:20.167914 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:29:20.167914 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: d6e8399080a942f1b689fc8c6b42c717 Jul 31 14:29:20.167914 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:29:20.167914 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:29:20.167914 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance b65263c9-40f6-48e3-9e44-b8654f688d07 could not be found. Jul 31 14:29:20.167914 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': 'b65263c9-40f6-48e3-9e44-b8654f688d07'} Jul 31 14:29:20.168772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:29:20.168772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:20.168772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:29:20.168772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:29:20.168772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:29:20.168772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:29:20.168772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:29:20.168772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:29:20.168772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:29:20.168772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:29:20.168772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b65263c9-40f6-48e3-9e44-b8654f688d07 could not be found. Jul 31 14:29:20.168772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:20.168772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:20.168772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:20.168772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:20.168772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:20.168772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:20.168772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:29:20.168772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:29:20.168772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:29:20.170206 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:29:20.170206 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:29:20.170206 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:29:20.170206 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:29:20.170206 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:29:20.170206 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:29:20.170206 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:29:20.170206 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b65263c9-40f6-48e3-9e44-b8654f688d07 could not be found. Jul 31 14:29:20.170206 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:20.170206 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:20.170206 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:20.170206 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:20.170206 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:20.170206 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:20.170206 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:29:20.170206 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:29:20.170206 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b65263c9-40f6-48e3-9e44-b8654f688d07 could not be found. Jul 31 14:29:20.170206 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:20.171475 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1e70c64e-322f-44e8-8b1f-d62533aec3ad tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Returning 404 to user: Instance b65263c9-40f6-48e3-9e44-b8654f688d07 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:29:20.171475 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1e70c64e-322f-44e8-8b1f-d62533aec3ad tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07" status: 404 len: 111 microversion: 2.1 time: 0.029598 Jul 31 14:29:20.171475 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 434/845] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:29:20 2022] GET /compute/v2.1/servers/b65263c9-40f6-48e3-9e44-b8654f688d07 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:29:20.176572 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-64a6bbcc-6c8d-4501-8a12-1044eff19523 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:20.177074 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-64a6bbcc-6c8d-4501-8a12-1044eff19523 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:20.183372 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-64a6bbcc-6c8d-4501-8a12-1044eff19523 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:20.183851 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-64a6bbcc-6c8d-4501-8a12-1044eff19523 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:20.184611 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-64a6bbcc-6c8d-4501-8a12-1044eff19523 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:20.185046 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-64a6bbcc-6c8d-4501-8a12-1044eff19523 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:20.198696 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.wsgi [None req-64a6bbcc-6c8d-4501-8a12-1044eff19523 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] HTTP exception thrown: Instance ed5b3d28-2f47-4309-a909-0210c782aad3 could not be found. Jul 31 14:29:20.200446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-64a6bbcc-6c8d-4501-8a12-1044eff19523 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Request method failure captured: Jul 31 14:29:20.200446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: request: DELETE /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 HTTP/1.1 Jul 31 14:29:20.200446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept: application/json Jul 31 14:29:20.200446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept-Encoding: identity Jul 31 14:29:20.200446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Connection: close Jul 31 14:29:20.200446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Length: 0 Jul 31 14:29:20.200446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Type: application/json Jul 31 14:29:20.200446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Host: 10.222.0.40 Jul 31 14:29:20.200446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Openstack-System-Scope: None Jul 31 14:29:20.200446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: User-Agent: python-urllib3/1.26.10 Jul 31 14:29:20.200446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Auth-Token: gAAAAABi5pA3RnV2a-dDWWL-_ZfxXcr4UktgQI-9SWPGN4xUIh3gpaTPpUlCMNWU1g96nJfR_a1KYUrPG43SkpeWWkH3LXQwcjtBN7d_0kQ02fiRqueKY6XZVQNh8gR0_ddCj_gKuHBtsN430P5RXgDqCVuPQ_rcT-N1y6dWBKzFpQGKjlxkqC0 Jul 31 14:29:20.200446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Id: None Jul 31 14:29:20.200446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Name: None Jul 31 14:29:20.200446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Identity-Status: Confirmed Jul 31 14:29:20.200446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Is-Admin-Project: True Jul 31 14:29:20.200446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Id: default Jul 31 14:29:20.200446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Name: Default Jul 31 14:29:20.200446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:29:20.200446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:20.200446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Role: reader,member Jul 31 14:29:20.200446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Roles: reader,member Jul 31 14:29:20.202044 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9097fd66951e457ba46812ff17db7501", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9097fd66951e457ba46812ff17db7501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:29:20.202044 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:20.202044 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:29:20.202044 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:20.202044 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:29:20.202044 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Id: default Jul 31 14:29:20.202044 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Name: Default Jul 31 14:29:20.202044 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Id: d6e8399080a942f1b689fc8c6b42c717 Jul 31 14:29:20.202044 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Name: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:29:20.202044 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: method: > Jul 31 14:29:20.202044 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: exception: Instance ed5b3d28-2f47-4309-a909-0210c782aad3 could not be found. Jul 31 14:29:20.202044 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: action_args: {'id': 'ed5b3d28-2f47-4309-a909-0210c782aad3'} Jul 31 14:29:20.203030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:29:20.203030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:20.203030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:29:20.203030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:29:20.203030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:29:20.203030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:29:20.203030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:29:20.203030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:29:20.203030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:29:20.203030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:29:20.203030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed5b3d28-2f47-4309-a909-0210c782aad3 could not be found. Jul 31 14:29:20.203030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:20.203030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:20.203030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:20.203030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:20.203030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:20.203030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:20.203030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:29:20.203030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:29:20.203030 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:29:20.204479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:29:20.204479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 14:29:20.204479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 14:29:20.204479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 14:29:20.204479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 14:29:20.204479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:29:20.204479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:29:20.204479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:29:20.204479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:29:20.204479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed5b3d28-2f47-4309-a909-0210c782aad3 could not be found. Jul 31 14:29:20.204479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:20.204479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:20.204479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:20.204479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:20.204479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:20.204479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:20.204479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:29:20.204479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:29:20.204479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed5b3d28-2f47-4309-a909-0210c782aad3 could not be found. Jul 31 14:29:20.204479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:20.206097 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-64a6bbcc-6c8d-4501-8a12-1044eff19523 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Returning 404 to user: Instance ed5b3d28-2f47-4309-a909-0210c782aad3 could not be found. {{(pid=117781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:29:20.206097 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-64a6bbcc-6c8d-4501-8a12-1044eff19523 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 404 len: 111 microversion: 2.1 time: 0.029424 Jul 31 14:29:20.206097 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 412/846] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:29:20 2022] DELETE /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:29:20.210767 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-160589fe-705f-4908-a4d4-e01042ff15ed tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:20.211389 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-160589fe-705f-4908-a4d4-e01042ff15ed tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: ed5b3d28-2f47-4309-a909-0210c782aad3] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:20.217430 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-160589fe-705f-4908-a4d4-e01042ff15ed tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:20.217879 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-160589fe-705f-4908-a4d4-e01042ff15ed tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:20.218644 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-160589fe-705f-4908-a4d4-e01042ff15ed tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:20.219081 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-160589fe-705f-4908-a4d4-e01042ff15ed tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:20.232297 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-160589fe-705f-4908-a4d4-e01042ff15ed tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] HTTP exception thrown: Instance ed5b3d28-2f47-4309-a909-0210c782aad3 could not be found. Jul 31 14:29:20.233820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-160589fe-705f-4908-a4d4-e01042ff15ed tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Request method failure captured: Jul 31 14:29:20.233820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 HTTP/1.1 Jul 31 14:29:20.233820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:29:20.233820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:29:20.233820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:29:20.233820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:29:20.233820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:29:20.233820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:29:20.233820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:29:20.233820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:29:20.233820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pA3RnV2a-dDWWL-_ZfxXcr4UktgQI-9SWPGN4xUIh3gpaTPpUlCMNWU1g96nJfR_a1KYUrPG43SkpeWWkH3LXQwcjtBN7d_0kQ02fiRqueKY6XZVQNh8gR0_ddCj_gKuHBtsN430P5RXgDqCVuPQ_rcT-N1y6dWBKzFpQGKjlxkqC0 Jul 31 14:29:20.233820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:29:20.233820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:29:20.233820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:29:20.233820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:29:20.233820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:29:20.233820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:29:20.233820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:29:20.233820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:20.233820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:29:20.233820 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:29:20.235345 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9097fd66951e457ba46812ff17db7501", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9097fd66951e457ba46812ff17db7501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:29:20.235345 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:20.235345 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:29:20.235345 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:20.235345 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:29:20.235345 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:29:20.235345 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:29:20.235345 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: d6e8399080a942f1b689fc8c6b42c717 Jul 31 14:29:20.235345 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:29:20.235345 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:29:20.235345 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance ed5b3d28-2f47-4309-a909-0210c782aad3 could not be found. Jul 31 14:29:20.235345 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': 'ed5b3d28-2f47-4309-a909-0210c782aad3'} Jul 31 14:29:20.236248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:29:20.236248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:20.236248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:29:20.236248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:29:20.236248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:29:20.236248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:29:20.236248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:29:20.236248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:29:20.236248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:29:20.236248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:29:20.236248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed5b3d28-2f47-4309-a909-0210c782aad3 could not be found. Jul 31 14:29:20.236248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:20.236248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:20.236248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:20.236248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:20.236248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:20.236248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:20.236248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:29:20.236248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:29:20.236248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:29:20.237782 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:29:20.237782 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:29:20.237782 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:29:20.237782 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:29:20.237782 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:29:20.237782 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:29:20.237782 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:29:20.237782 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed5b3d28-2f47-4309-a909-0210c782aad3 could not be found. Jul 31 14:29:20.237782 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:20.237782 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:20.237782 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:20.237782 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:20.237782 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:20.237782 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:20.237782 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:29:20.237782 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:29:20.237782 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed5b3d28-2f47-4309-a909-0210c782aad3 could not be found. Jul 31 14:29:20.237782 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:20.239378 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-160589fe-705f-4908-a4d4-e01042ff15ed tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Returning 404 to user: Instance ed5b3d28-2f47-4309-a909-0210c782aad3 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:29:20.239378 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-160589fe-705f-4908-a4d4-e01042ff15ed tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3" status: 404 len: 111 microversion: 2.1 time: 0.028918 Jul 31 14:29:20.239378 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 435/847] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:29:20 2022] GET /compute/v2.1/servers/ed5b3d28-2f47-4309-a909-0210c782aad3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:29:21.374418 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-18c3c4c0-4299-4bf8-95e9-f5b0e161abdc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:21.374920 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-18c3c4c0-4299-4bf8-95e9-f5b0e161abdc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:21.381360 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-18c3c4c0-4299-4bf8-95e9-f5b0e161abdc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:21.381812 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-18c3c4c0-4299-4bf8-95e9-f5b0e161abdc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:21.382584 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-18c3c4c0-4299-4bf8-95e9-f5b0e161abdc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:21.383022 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-18c3c4c0-4299-4bf8-95e9-f5b0e161abdc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:21.398042 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.wsgi [None req-18c3c4c0-4299-4bf8-95e9-f5b0e161abdc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] HTTP exception thrown: Instance e4f24854-1bcd-405b-9af8-fd3f3967d16b could not be found. Jul 31 14:29:21.399606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-18c3c4c0-4299-4bf8-95e9-f5b0e161abdc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Request method failure captured: Jul 31 14:29:21.399606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: request: DELETE /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b HTTP/1.1 Jul 31 14:29:21.399606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept: application/json Jul 31 14:29:21.399606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept-Encoding: identity Jul 31 14:29:21.399606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Connection: close Jul 31 14:29:21.399606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Length: 0 Jul 31 14:29:21.399606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Type: application/json Jul 31 14:29:21.399606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Host: 10.222.0.40 Jul 31 14:29:21.399606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Openstack-System-Scope: None Jul 31 14:29:21.399606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: User-Agent: python-urllib3/1.26.10 Jul 31 14:29:21.399606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Auth-Token: gAAAAABi5pA3RnV2a-dDWWL-_ZfxXcr4UktgQI-9SWPGN4xUIh3gpaTPpUlCMNWU1g96nJfR_a1KYUrPG43SkpeWWkH3LXQwcjtBN7d_0kQ02fiRqueKY6XZVQNh8gR0_ddCj_gKuHBtsN430P5RXgDqCVuPQ_rcT-N1y6dWBKzFpQGKjlxkqC0 Jul 31 14:29:21.399606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Id: None Jul 31 14:29:21.399606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Name: None Jul 31 14:29:21.399606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Identity-Status: Confirmed Jul 31 14:29:21.399606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Is-Admin-Project: True Jul 31 14:29:21.399606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Id: default Jul 31 14:29:21.399606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Name: Default Jul 31 14:29:21.399606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:29:21.399606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:21.399606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Role: reader,member Jul 31 14:29:21.399606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Roles: reader,member Jul 31 14:29:21.401164 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9097fd66951e457ba46812ff17db7501", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9097fd66951e457ba46812ff17db7501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:29:21.401164 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:21.401164 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:29:21.401164 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:21.401164 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:29:21.401164 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Id: default Jul 31 14:29:21.401164 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Name: Default Jul 31 14:29:21.401164 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Id: d6e8399080a942f1b689fc8c6b42c717 Jul 31 14:29:21.401164 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Name: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:29:21.401164 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: method: > Jul 31 14:29:21.401164 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: exception: Instance e4f24854-1bcd-405b-9af8-fd3f3967d16b could not be found. Jul 31 14:29:21.401164 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: action_args: {'id': 'e4f24854-1bcd-405b-9af8-fd3f3967d16b'} Jul 31 14:29:21.401956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:29:21.401956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:21.401956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:29:21.401956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:29:21.401956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:29:21.401956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:29:21.401956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:29:21.401956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:29:21.401956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:29:21.401956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:29:21.401956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4f24854-1bcd-405b-9af8-fd3f3967d16b could not be found. Jul 31 14:29:21.401956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:21.401956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:21.401956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:21.401956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:21.401956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:21.401956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:21.401956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:29:21.401956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:29:21.401956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:29:21.403160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:29:21.403160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 14:29:21.403160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 14:29:21.403160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 14:29:21.403160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 14:29:21.403160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:29:21.403160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:29:21.403160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:29:21.403160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:29:21.403160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4f24854-1bcd-405b-9af8-fd3f3967d16b could not be found. Jul 31 14:29:21.403160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:21.403160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:21.403160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:21.403160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:21.403160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:21.403160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:21.403160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:29:21.403160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:29:21.403160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4f24854-1bcd-405b-9af8-fd3f3967d16b could not be found. Jul 31 14:29:21.403160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:21.404616 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-18c3c4c0-4299-4bf8-95e9-f5b0e161abdc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Returning 404 to user: Instance e4f24854-1bcd-405b-9af8-fd3f3967d16b could not be found. {{(pid=117781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:29:21.404616 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-18c3c4c0-4299-4bf8-95e9-f5b0e161abdc tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "DELETE /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 404 len: 111 microversion: 2.1 time: 0.030362 Jul 31 14:29:21.404616 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 413/848] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:29:21 2022] DELETE /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:29:21.409882 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-608cf219-a405-40ab-a400-d49dab4afec2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:21.410487 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-608cf219-a405-40ab-a400-d49dab4afec2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] [instance: e4f24854-1bcd-405b-9af8-fd3f3967d16b] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:21.416885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-608cf219-a405-40ab-a400-d49dab4afec2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:21.417310 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-608cf219-a405-40ab-a400-d49dab4afec2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:21.418061 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-608cf219-a405-40ab-a400-d49dab4afec2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:21.418490 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-608cf219-a405-40ab-a400-d49dab4afec2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:21.431406 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-608cf219-a405-40ab-a400-d49dab4afec2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] HTTP exception thrown: Instance e4f24854-1bcd-405b-9af8-fd3f3967d16b could not be found. Jul 31 14:29:21.432918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-608cf219-a405-40ab-a400-d49dab4afec2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Request method failure captured: Jul 31 14:29:21.432918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b HTTP/1.1 Jul 31 14:29:21.432918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:29:21.432918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:29:21.432918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:29:21.432918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:29:21.432918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:29:21.432918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:29:21.432918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:29:21.432918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:29:21.432918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pA3RnV2a-dDWWL-_ZfxXcr4UktgQI-9SWPGN4xUIh3gpaTPpUlCMNWU1g96nJfR_a1KYUrPG43SkpeWWkH3LXQwcjtBN7d_0kQ02fiRqueKY6XZVQNh8gR0_ddCj_gKuHBtsN430P5RXgDqCVuPQ_rcT-N1y6dWBKzFpQGKjlxkqC0 Jul 31 14:29:21.432918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:29:21.432918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:29:21.432918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:29:21.432918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:29:21.432918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:29:21.432918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:29:21.432918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:29:21.432918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:21.432918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:29:21.432918 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:29:21.434404 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_9097fd66951e457ba46812ff17db7501", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/9097fd66951e457ba46812ff17db7501"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/9097fd66951e457ba46812ff17db7501"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:29:21.434404 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:21.434404 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 9097fd66951e457ba46812ff17db7501 Jul 31 14:29:21.434404 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-418126257 Jul 31 14:29:21.434404 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:29:21.434404 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:29:21.434404 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:29:21.434404 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: d6e8399080a942f1b689fc8c6b42c717 Jul 31 14:29:21.434404 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeNegativeTest-418126257-project Jul 31 14:29:21.434404 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:29:21.434404 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance e4f24854-1bcd-405b-9af8-fd3f3967d16b could not be found. Jul 31 14:29:21.434404 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': 'e4f24854-1bcd-405b-9af8-fd3f3967d16b'} Jul 31 14:29:21.435205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:29:21.435205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:21.435205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:29:21.435205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:29:21.435205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:29:21.435205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:29:21.435205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:29:21.435205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:29:21.435205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:29:21.435205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:29:21.435205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4f24854-1bcd-405b-9af8-fd3f3967d16b could not be found. Jul 31 14:29:21.435205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:21.435205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:21.435205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:21.435205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:21.435205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:21.435205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:21.435205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:29:21.435205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:29:21.435205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:29:21.436511 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:29:21.436511 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:29:21.436511 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:29:21.436511 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:29:21.436511 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:29:21.436511 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:29:21.436511 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:29:21.436511 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4f24854-1bcd-405b-9af8-fd3f3967d16b could not be found. Jul 31 14:29:21.436511 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:21.436511 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:21.436511 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:21.436511 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:21.436511 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:21.436511 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:21.436511 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:29:21.436511 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:29:21.436511 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4f24854-1bcd-405b-9af8-fd3f3967d16b could not be found. Jul 31 14:29:21.436511 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:21.437637 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-608cf219-a405-40ab-a400-d49dab4afec2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] Returning 404 to user: Instance e4f24854-1bcd-405b-9af8-fd3f3967d16b could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:29:21.437637 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-608cf219-a405-40ab-a400-d49dab4afec2 tempest-AttachVolumeNegativeTest-418126257 tempest-AttachVolumeNegativeTest-418126257-project] 10.222.0.40 "GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b" status: 404 len: 111 microversion: 2.1 time: 0.028724 Jul 31 14:29:21.437637 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 436/849] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:29:21 2022] GET /compute/v2.1/servers/e4f24854-1bcd-405b-9af8-fd3f3967d16b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:29:30.140316 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-9b15678c-854a-470f-8954-e8c836b913f0 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:30.141486 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-9b15678c-854a-470f-8954-e8c836b913f0 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:30.143388 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-3a3d0461-e9ea-4c5f-81c6-c2dbc09c6f2b req-f10cdb13-941c-4784-a02a-025e86b47cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92439dcd-76b3-44fb-882b-1b8f0dcb9d73", "tag": "e91303da-f1e0-49da-acae-3ce6750984f8"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:29:30.153957 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9b15678c-854a-470f-8954-e8c836b913f0 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:30.154896 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9b15678c-854a-470f-8954-e8c836b913f0 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:30.156345 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9b15678c-854a-470f-8954-e8c836b913f0 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:30.157067 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9b15678c-854a-470f-8954-e8c836b913f0 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:30.166876 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-3a3d0461-e9ea-4c5f-81c6-c2dbc09c6f2b req-f10cdb13-941c-4784-a02a-025e86b47cea service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:30.167798 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-3a3d0461-e9ea-4c5f-81c6-c2dbc09c6f2b req-f10cdb13-941c-4784-a02a-025e86b47cea service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:30.185983 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-3a3d0461-e9ea-4c5f-81c6-c2dbc09c6f2b req-f10cdb13-941c-4784-a02a-025e86b47cea service nova] Creating event network-changed:e91303da-f1e0-49da-acae-3ce6750984f8 for instance 92439dcd-76b3-44fb-882b-1b8f0dcb9d73 on hv-cinder-84984 Jul 31 14:29:30.191802 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-3a3d0461-e9ea-4c5f-81c6-c2dbc09c6f2b req-f10cdb13-941c-4784-a02a-025e86b47cea service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052422 Jul 31 14:29:30.191991 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-9b15678c-854a-470f-8954-e8c836b913f0 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Going to try to terminate instance {{(pid=117781) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 14:29:30.195413 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 437/850] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:29:30.309411 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-9b15678c-854a-470f-8954-e8c836b913f0 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "DELETE /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 204 len: 0 microversion: 2.1 time: 0.174195 Jul 31 14:29:30.312619 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 414/851] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:29:30 2022] DELETE /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 14:29:30.322751 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d20aee39-6534-4319-8b1f-6484a95866a1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:30.323621 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d20aee39-6534-4319-8b1f-6484a95866a1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:30.332950 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d20aee39-6534-4319-8b1f-6484a95866a1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:30.333837 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d20aee39-6534-4319-8b1f-6484a95866a1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:30.334816 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d20aee39-6534-4319-8b1f-6484a95866a1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:30.335402 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d20aee39-6534-4319-8b1f-6484a95866a1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:30.542370 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d20aee39-6534-4319-8b1f-6484a95866a1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:30.551584 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d20aee39-6534-4319-8b1f-6484a95866a1 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1566 microversion: 2.1 time: 0.233717 Jul 31 14:29:30.559128 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 438/852] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:29:30 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1566 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:29:31.574562 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-a84961fa-7d46-47c7-bbb9-bc83ce8d11c4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:31.577269 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-a84961fa-7d46-47c7-bbb9-bc83ce8d11c4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:31.591411 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a84961fa-7d46-47c7-bbb9-bc83ce8d11c4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:31.591891 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a84961fa-7d46-47c7-bbb9-bc83ce8d11c4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:31.592667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a84961fa-7d46-47c7-bbb9-bc83ce8d11c4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:31.593102 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a84961fa-7d46-47c7-bbb9-bc83ce8d11c4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:32.070287 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a84961fa-7d46-47c7-bbb9-bc83ce8d11c4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:32.078123 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-a84961fa-7d46-47c7-bbb9-bc83ce8d11c4 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1566 microversion: 2.1 time: 0.507800 Jul 31 14:29:32.079006 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 415/853] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:29:31 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1566 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:29:32.728101 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-c4767ec4-aac8-455f-bd0c-41ca209dedb7 req-122ade38-77c7-4d91-b321-028b899b6964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92439dcd-76b3-44fb-882b-1b8f0dcb9d73", "name": "network-vif-deleted", "tag": "e91303da-f1e0-49da-acae-3ce6750984f8"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:29:32.740604 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-c4767ec4-aac8-455f-bd0c-41ca209dedb7 req-122ade38-77c7-4d91-b321-028b899b6964 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:32.741047 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-c4767ec4-aac8-455f-bd0c-41ca209dedb7 req-122ade38-77c7-4d91-b321-028b899b6964 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:32.754834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-c4767ec4-aac8-455f-bd0c-41ca209dedb7 req-122ade38-77c7-4d91-b321-028b899b6964 service nova] Creating event network-vif-deleted:e91303da-f1e0-49da-acae-3ce6750984f8 for instance 92439dcd-76b3-44fb-882b-1b8f0dcb9d73 on hv-cinder-84984 Jul 31 14:29:32.760613 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-c4767ec4-aac8-455f-bd0c-41ca209dedb7 req-122ade38-77c7-4d91-b321-028b899b6964 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036147 Jul 31 14:29:32.761482 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 439/854] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:29:33.101130 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-eb8d2818-fea9-4b1b-825a-305a190ce72d tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:33.102509 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-eb8d2818-fea9-4b1b-825a-305a190ce72d tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:33.109200 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eb8d2818-fea9-4b1b-825a-305a190ce72d tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:33.110322 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eb8d2818-fea9-4b1b-825a-305a190ce72d tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:33.110816 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eb8d2818-fea9-4b1b-825a-305a190ce72d tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:33.111411 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-eb8d2818-fea9-4b1b-825a-305a190ce72d tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:33.199867 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-eb8d2818-fea9-4b1b-825a-305a190ce72d tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ca8614358245b99f621edc7f1d0021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ff0edf56fa403e8b9bf25fe004cdd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:33.209465 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-eb8d2818-fea9-4b1b-825a-305a190ce72d tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 200 len: 1218 microversion: 2.1 time: 0.112139 Jul 31 14:29:33.210291 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 416/855] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:29:33 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:29:34.230650 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ba936c4d-8125-49a4-8ede-09b5da9e4905 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:34.231344 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ba936c4d-8125-49a4-8ede-09b5da9e4905 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] [instance: 92439dcd-76b3-44fb-882b-1b8f0dcb9d73] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:34.233892 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:29:34.240479 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ba936c4d-8125-49a4-8ede-09b5da9e4905 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:34.240924 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ba936c4d-8125-49a4-8ede-09b5da9e4905 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:34.241690 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ba936c4d-8125-49a4-8ede-09b5da9e4905 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:34.242124 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ba936c4d-8125-49a4-8ede-09b5da9e4905 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:34.258595 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-ba936c4d-8125-49a4-8ede-09b5da9e4905 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] HTTP exception thrown: Instance 92439dcd-76b3-44fb-882b-1b8f0dcb9d73 could not be found. Jul 31 14:29:34.260267 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ba936c4d-8125-49a4-8ede-09b5da9e4905 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Request method failure captured: Jul 31 14:29:34.260267 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 HTTP/1.1 Jul 31 14:29:34.260267 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:29:34.260267 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:29:34.260267 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:29:34.260267 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:29:34.260267 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:29:34.260267 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:29:34.260267 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:29:34.260267 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:29:34.260267 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pCUh-YnhUzVvcsrEy5k_9yq5WAZgbC-VEs1pWBw1-BkooRAxjmiMWRMweyz3nQ3R6VOgE9VEPcPy2NI5HhAJaCeCrTgvdJwUHccLmyUXUJPkBBO9LG_Czbhb1rQKTdiyIU9dKnBHebsCkwUvZxmfEo995FwiJpQmm2_26oX1vQH3Fk Jul 31 14:29:34.260267 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:29:34.260267 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:29:34.260267 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:29:34.260267 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:29:34.260267 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:29:34.260267 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:29:34.260267 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: d9ff0edf56fa403e8b9bf25fe004cdd3 Jul 31 14:29:34.260267 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-TestShelveInstance-1074686679 Jul 31 14:29:34.260267 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:29:34.260267 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:29:34.261982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d9ff0edf56fa403e8b9bf25fe004cdd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_d9ff0edf56fa403e8b9bf25fe004cdd3", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/d9ff0edf56fa403e8b9bf25fe004cdd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/d9ff0edf56fa403e8b9bf25fe004cdd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:29:34.261982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-TestShelveInstance-1074686679 Jul 31 14:29:34.261982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: d9ff0edf56fa403e8b9bf25fe004cdd3 Jul 31 14:29:34.261982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-TestShelveInstance-1074686679 Jul 31 14:29:34.261982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-TestShelveInstance-1074686679-project Jul 31 14:29:34.261982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:29:34.261982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:29:34.261982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: 26ca8614358245b99f621edc7f1d0021 Jul 31 14:29:34.261982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-TestShelveInstance-1074686679-project Jul 31 14:29:34.261982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:29:34.261982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance 92439dcd-76b3-44fb-882b-1b8f0dcb9d73 could not be found. Jul 31 14:29:34.261982 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': '92439dcd-76b3-44fb-882b-1b8f0dcb9d73'} Jul 31 14:29:34.263114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:29:34.263114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:34.263114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:29:34.263114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:29:34.263114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:29:34.263114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:29:34.263114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:29:34.263114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:29:34.263114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:29:34.263114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:29:34.263114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92439dcd-76b3-44fb-882b-1b8f0dcb9d73 could not be found. Jul 31 14:29:34.263114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:34.263114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:34.263114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:34.263114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:34.263114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:34.263114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:34.263114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:29:34.263114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:29:34.263114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:29:34.264678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:29:34.264678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:29:34.264678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:29:34.264678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:29:34.264678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:29:34.264678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:29:34.264678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:29:34.264678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92439dcd-76b3-44fb-882b-1b8f0dcb9d73 could not be found. Jul 31 14:29:34.264678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:34.264678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:34.264678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:34.264678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:34.264678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:34.264678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:34.264678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:29:34.264678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:29:34.264678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92439dcd-76b3-44fb-882b-1b8f0dcb9d73 could not be found. Jul 31 14:29:34.264678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:34.266187 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ba936c4d-8125-49a4-8ede-09b5da9e4905 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Returning 404 to user: Instance 92439dcd-76b3-44fb-882b-1b8f0dcb9d73 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:29:34.266187 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ba936c4d-8125-49a4-8ede-09b5da9e4905 tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73" status: 404 len: 111 microversion: 2.1 time: 0.035258 Jul 31 14:29:34.266187 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 440/856] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:29:34 2022] GET /compute/v2.1/servers/92439dcd-76b3-44fb-882b-1b8f0dcb9d73 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:29:34.458167 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-8ecbbd57-2b8d-4f4d-8aa1-e1c887664fbf tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] Calling method '.version_select at 0x7f87e9a24820>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:34.489595 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-8ecbbd57-2b8d-4f4d-8aa1-e1c887664fbf tempest-TestShelveInstance-1074686679 tempest-TestShelveInstance-1074686679-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-56261385" status: 202 len: 0 microversion: 2.1 time: 0.036255 Jul 31 14:29:34.490630 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 417/857] 10.222.0.40 () {58 vars in 1248 bytes} [Sun Jul 31 14:29:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-56261385 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:29:46.763280 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-39cc086d-7276-4114-8cf2-1221e10d1c4a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:46.765676 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-39cc086d-7276-4114-8cf2-1221e10d1c4a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:46.768810 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:29:46.769530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:29:46.775846 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-39cc086d-7276-4114-8cf2-1221e10d1c4a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:46.776290 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-39cc086d-7276-4114-8cf2-1221e10d1c4a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:46.777053 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-39cc086d-7276-4114-8cf2-1221e10d1c4a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:46.777484 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-39cc086d-7276-4114-8cf2-1221e10d1c4a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:46.807731 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-39cc086d-7276-4114-8cf2-1221e10d1c4a tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048537 Jul 31 14:29:46.808299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 441/858] 10.222.0.40 () {60 vars in 1343 bytes} [Sun Jul 31 14:29:46 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:29:46.869526 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:29:46.870283 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:29:46.874108 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-e8418f9e-801d-4699-ab68-395af4914ebb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:46.874603 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-e8418f9e-801d-4699-ab68-395af4914ebb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:46.882643 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e8418f9e-801d-4699-ab68-395af4914ebb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:46.883093 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e8418f9e-801d-4699-ab68-395af4914ebb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:46.883889 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e8418f9e-801d-4699-ab68-395af4914ebb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:46.884330 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e8418f9e-801d-4699-ab68-395af4914ebb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:46.914958 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-e8418f9e-801d-4699-ab68-395af4914ebb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Going to try to terminate instance {{(pid=117781) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 14:29:46.993461 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-e8418f9e-801d-4699-ab68-395af4914ebb tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 204 len: 0 microversion: 2.20 time: 0.125239 Jul 31 14:29:46.997120 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 418/859] 10.222.0.40 () {60 vars in 1280 bytes} [Sun Jul 31 14:29:46 2022] DELETE /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 31 14:29:47.003268 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0b1121b5-0670-4ca0-9ff6-0f727739cc88 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:47.004152 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0b1121b5-0670-4ca0-9ff6-0f727739cc88 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:47.010466 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0b1121b5-0670-4ca0-9ff6-0f727739cc88 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:47.011098 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0b1121b5-0670-4ca0-9ff6-0f727739cc88 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:47.011929 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0b1121b5-0670-4ca0-9ff6-0f727739cc88 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:47.012386 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0b1121b5-0670-4ca0-9ff6-0f727739cc88 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:47.145933 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0b1121b5-0670-4ca0-9ff6-0f727739cc88 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:47.153970 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0b1121b5-0670-4ca0-9ff6-0f727739cc88 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:47.155522 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0b1121b5-0670-4ca0-9ff6-0f727739cc88 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:47.156708 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0b1121b5-0670-4ca0-9ff6-0f727739cc88 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1725 microversion: 2.20 time: 0.158323 Jul 31 14:29:47.157278 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 442/860] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:29:46 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:29:48.182401 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-3ebe8f47-c36a-4fcb-b48c-28708beaa8df tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:48.183104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-3ebe8f47-c36a-4fcb-b48c-28708beaa8df tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:48.190105 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3ebe8f47-c36a-4fcb-b48c-28708beaa8df tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:48.190556 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3ebe8f47-c36a-4fcb-b48c-28708beaa8df tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:48.191331 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3ebe8f47-c36a-4fcb-b48c-28708beaa8df tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:48.191800 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3ebe8f47-c36a-4fcb-b48c-28708beaa8df tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:48.332665 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-3ebe8f47-c36a-4fcb-b48c-28708beaa8df tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:48.341881 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-3ebe8f47-c36a-4fcb-b48c-28708beaa8df tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:48.348341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-3ebe8f47-c36a-4fcb-b48c-28708beaa8df tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:48.349773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-3ebe8f47-c36a-4fcb-b48c-28708beaa8df tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1725 microversion: 2.20 time: 0.171733 Jul 31 14:29:48.350405 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 419/861] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:29:48 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:29:49.327238 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-5600f8a3-33db-4350-adb2-e2fef0244f1d req-f2012fc9-0e44-45a1-bd69-ca42b9f56f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6200d587-a817-4a77-b242-ec578e8e57dc", "name": "network-vif-deleted", "tag": "414cf0f9-b0cd-4363-9160-1242693140a5"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:29:49.337957 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-5600f8a3-33db-4350-adb2-e2fef0244f1d req-f2012fc9-0e44-45a1-bd69-ca42b9f56f01 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:49.338717 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-5600f8a3-33db-4350-adb2-e2fef0244f1d req-f2012fc9-0e44-45a1-bd69-ca42b9f56f01 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:49.351169 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-5600f8a3-33db-4350-adb2-e2fef0244f1d req-f2012fc9-0e44-45a1-bd69-ca42b9f56f01 service nova] Creating event network-vif-deleted:414cf0f9-b0cd-4363-9160-1242693140a5 for instance 6200d587-a817-4a77-b242-ec578e8e57dc on hv-cinder-84984 Jul 31 14:29:49.356113 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-5600f8a3-33db-4350-adb2-e2fef0244f1d req-f2012fc9-0e44-45a1-bd69-ca42b9f56f01 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033525 Jul 31 14:29:49.356798 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 443/862] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:29:49.374016 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-49ddfd8f-7883-4942-9c6f-37ac2fc888dd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:49.374797 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-49ddfd8f-7883-4942-9c6f-37ac2fc888dd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:49.381762 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-49ddfd8f-7883-4942-9c6f-37ac2fc888dd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:49.383086 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-49ddfd8f-7883-4942-9c6f-37ac2fc888dd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:49.384201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-49ddfd8f-7883-4942-9c6f-37ac2fc888dd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:49.384881 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-49ddfd8f-7883-4942-9c6f-37ac2fc888dd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:49.459960 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-49ddfd8f-7883-4942-9c6f-37ac2fc888dd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:49.469768 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-49ddfd8f-7883-4942-9c6f-37ac2fc888dd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:49.472185 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-49ddfd8f-7883-4942-9c6f-37ac2fc888dd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:49.473653 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-49ddfd8f-7883-4942-9c6f-37ac2fc888dd tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1657 microversion: 2.20 time: 0.103622 Jul 31 14:29:49.474446 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 420/863] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:29:49 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1657 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:29:50.498547 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-db6ae704-ae02-4772-938a-3e693317e096 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:50.499234 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-db6ae704-ae02-4772-938a-3e693317e096 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:50.506032 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-db6ae704-ae02-4772-938a-3e693317e096 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:50.506475 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-db6ae704-ae02-4772-938a-3e693317e096 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:50.507232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-db6ae704-ae02-4772-938a-3e693317e096 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:50.507694 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-db6ae704-ae02-4772-938a-3e693317e096 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:50.571745 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-db6ae704-ae02-4772-938a-3e693317e096 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:50.579817 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-db6ae704-ae02-4772-938a-3e693317e096 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:50.581358 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-db6ae704-ae02-4772-938a-3e693317e096 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:50.582484 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-db6ae704-ae02-4772-938a-3e693317e096 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1367 microversion: 2.20 time: 0.088618 Jul 31 14:29:50.583040 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 444/864] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:29:50 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1367 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:29:51.604771 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-8a2dba21-cfbe-4477-8096-264679a7a1f4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:51.605377 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-8a2dba21-cfbe-4477-8096-264679a7a1f4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:51.612637 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8a2dba21-cfbe-4477-8096-264679a7a1f4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:51.613077 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8a2dba21-cfbe-4477-8096-264679a7a1f4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:51.613831 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8a2dba21-cfbe-4477-8096-264679a7a1f4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:51.614271 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8a2dba21-cfbe-4477-8096-264679a7a1f4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:51.799732 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8a2dba21-cfbe-4477-8096-264679a7a1f4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:51.800081 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8a2dba21-cfbe-4477-8096-264679a7a1f4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:51.800541 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.objects.instance [None req-8a2dba21-cfbe-4477-8096-264679a7a1f4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lazy-loading 'fault' on Instance uuid 6200d587-a817-4a77-b242-ec578e8e57dc {{(pid=117781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:29:51.841354 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-8a2dba21-cfbe-4477-8096-264679a7a1f4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:51.849210 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-8a2dba21-cfbe-4477-8096-264679a7a1f4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:51.850695 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-8a2dba21-cfbe-4477-8096-264679a7a1f4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53dab2ec3f2e4973893fb838c3d1d545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae629f9940d446f2ab39e9a49b3f4753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:29:51.851865 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-8a2dba21-cfbe-4477-8096-264679a7a1f4 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 200 len: 1372 microversion: 2.20 time: 0.251104 Jul 31 14:29:51.852413 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 421/865] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:29:51 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 1372 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 31 14:29:52.877433 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-88b5b46a-b716-4824-ba26-eb3bf8cc6db0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:52.878191 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-88b5b46a-b716-4824-ba26-eb3bf8cc6db0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:52.886184 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-88b5b46a-b716-4824-ba26-eb3bf8cc6db0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:52.886637 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-88b5b46a-b716-4824-ba26-eb3bf8cc6db0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:52.887644 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-88b5b46a-b716-4824-ba26-eb3bf8cc6db0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:52.888131 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-88b5b46a-b716-4824-ba26-eb3bf8cc6db0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:52.902181 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-88b5b46a-b716-4824-ba26-eb3bf8cc6db0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] HTTP exception thrown: Instance 6200d587-a817-4a77-b242-ec578e8e57dc could not be found. Jul 31 14:29:52.903992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-88b5b46a-b716-4824-ba26-eb3bf8cc6db0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Request method failure captured: Jul 31 14:29:52.903992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc HTTP/1.1 Jul 31 14:29:52.903992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:29:52.903992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:29:52.903992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:29:52.903992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:29:52.903992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:29:52.903992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:29:52.903992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:29:52.903992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:29:52.903992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pBBs2shScHoVtG00dWWTh4-8002n0L0mrPn1eGdaBMS3DhpBfsEI9mDgxa2AQImCzjjFCcdbxLTKChvhAaGdGz-LBQ2Ug9xuiFaDHM-Is8fWpkTMwPzMnujnc1YvJ7kfFW1o7r3Zmcil2Je8fqL9ldp7fVMB7icAZWBLQAFDG5mIbU Jul 31 14:29:52.903992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:29:52.903992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:29:52.903992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:29:52.903992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:29:52.903992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 14:29:52.903992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:29:52.903992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:29:52.903992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: ae629f9940d446f2ab39e9a49b3f4753 Jul 31 14:29:52.903992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2143433277 Jul 31 14:29:52.903992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:29:52.903992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:29:52.905671 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ae629f9940d446f2ab39e9a49b3f4753"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ae629f9940d446f2ab39e9a49b3f4753", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ae629f9940d446f2ab39e9a49b3f4753"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ae629f9940d446f2ab39e9a49b3f4753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:29:52.905671 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2143433277 Jul 31 14:29:52.905671 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: ae629f9940d446f2ab39e9a49b3f4753 Jul 31 14:29:52.905671 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2143433277 Jul 31 14:29:52.905671 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeShelveTestJSON-2143433277-project Jul 31 14:29:52.905671 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:29:52.905671 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:29:52.905671 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: 53dab2ec3f2e4973893fb838c3d1d545 Jul 31 14:29:52.905671 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2143433277-project Jul 31 14:29:52.905671 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:29:52.905671 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance 6200d587-a817-4a77-b242-ec578e8e57dc could not be found. Jul 31 14:29:52.905671 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': '6200d587-a817-4a77-b242-ec578e8e57dc'} Jul 31 14:29:52.906980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:29:52.906980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:52.906980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:29:52.906980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:29:52.906980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:29:52.906980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:29:52.906980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:29:52.906980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:29:52.906980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:29:52.906980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:29:52.906980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6200d587-a817-4a77-b242-ec578e8e57dc could not be found. Jul 31 14:29:52.906980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:52.906980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:52.906980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:52.906980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:52.906980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:52.906980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:52.906980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:29:52.906980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:29:52.906980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:29:52.909003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:29:52.909003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:29:52.909003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:29:52.909003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:29:52.909003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:29:52.909003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:29:52.909003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:29:52.909003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6200d587-a817-4a77-b242-ec578e8e57dc could not be found. Jul 31 14:29:52.909003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:52.909003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:52.909003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:52.909003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:52.909003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:52.909003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:52.909003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:29:52.909003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:29:52.909003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6200d587-a817-4a77-b242-ec578e8e57dc could not be found. Jul 31 14:29:52.909003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:52.910798 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-88b5b46a-b716-4824-ba26-eb3bf8cc6db0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Returning 404 to user: Instance 6200d587-a817-4a77-b242-ec578e8e57dc could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:29:52.910798 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-88b5b46a-b716-4824-ba26-eb3bf8cc6db0 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 404 len: 111 microversion: 2.20 time: 0.033090 Jul 31 14:29:52.910798 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 445/866] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:29:52 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 31 14:29:52.914956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-96ffa400-473f-4fd5-bb11-57d1dc98cc30 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '.version_select at 0x7f87e9891dc0>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:52.933319 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-96ffa400-473f-4fd5-bb11-57d1dc98cc30 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1310930531" status: 204 len: 0 microversion: 2.20 time: 0.022094 Jul 31 14:29:52.933866 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 422/867] 10.222.0.40 () {60 vars in 1262 bytes} [Sun Jul 31 14:29:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1310930531 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 31 14:29:56.763241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2574d143-e3af-4940-9330-5149b38776d6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:56.764570 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2574d143-e3af-4940-9330-5149b38776d6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:56.773122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2574d143-e3af-4940-9330-5149b38776d6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:56.773580 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2574d143-e3af-4940-9330-5149b38776d6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:56.774362 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2574d143-e3af-4940-9330-5149b38776d6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:56.774809 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2574d143-e3af-4940-9330-5149b38776d6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:56.788593 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-2574d143-e3af-4940-9330-5149b38776d6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] HTTP exception thrown: Instance 6200d587-a817-4a77-b242-ec578e8e57dc could not be found. Jul 31 14:29:56.790151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2574d143-e3af-4940-9330-5149b38776d6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Request method failure captured: Jul 31 14:29:56.790151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: DELETE /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc HTTP/1.1 Jul 31 14:29:56.790151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:29:56.790151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:29:56.790151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:29:56.790151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:29:56.790151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:29:56.790151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:29:56.790151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:29:56.790151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:29:56.790151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pBBs2shScHoVtG00dWWTh4-8002n0L0mrPn1eGdaBMS3DhpBfsEI9mDgxa2AQImCzjjFCcdbxLTKChvhAaGdGz-LBQ2Ug9xuiFaDHM-Is8fWpkTMwPzMnujnc1YvJ7kfFW1o7r3Zmcil2Je8fqL9ldp7fVMB7icAZWBLQAFDG5mIbU Jul 31 14:29:56.790151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:29:56.790151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:29:56.790151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:29:56.790151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:29:56.790151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 14:29:56.790151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:29:56.790151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:29:56.790151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: ae629f9940d446f2ab39e9a49b3f4753 Jul 31 14:29:56.790151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2143433277 Jul 31 14:29:56.790151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:29:56.790151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:29:56.791651 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ae629f9940d446f2ab39e9a49b3f4753"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ae629f9940d446f2ab39e9a49b3f4753", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ae629f9940d446f2ab39e9a49b3f4753"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ae629f9940d446f2ab39e9a49b3f4753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:29:56.791651 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2143433277 Jul 31 14:29:56.791651 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: ae629f9940d446f2ab39e9a49b3f4753 Jul 31 14:29:56.791651 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2143433277 Jul 31 14:29:56.791651 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeShelveTestJSON-2143433277-project Jul 31 14:29:56.791651 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:29:56.791651 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:29:56.791651 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: 53dab2ec3f2e4973893fb838c3d1d545 Jul 31 14:29:56.791651 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2143433277-project Jul 31 14:29:56.791651 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:29:56.791651 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance 6200d587-a817-4a77-b242-ec578e8e57dc could not be found. Jul 31 14:29:56.791651 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': '6200d587-a817-4a77-b242-ec578e8e57dc'} Jul 31 14:29:56.792415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:29:56.792415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:56.792415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:29:56.792415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:29:56.792415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:29:56.792415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:29:56.792415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:29:56.792415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:29:56.792415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:29:56.792415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:29:56.792415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6200d587-a817-4a77-b242-ec578e8e57dc could not be found. Jul 31 14:29:56.792415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:56.792415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:56.792415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:56.792415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:56.792415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:56.792415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:56.792415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:29:56.792415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:29:56.792415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:29:56.793634 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:29:56.793634 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 14:29:56.793634 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 14:29:56.793634 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 14:29:56.793634 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 14:29:56.793634 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:29:56.793634 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:29:56.793634 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:29:56.793634 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:29:56.793634 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6200d587-a817-4a77-b242-ec578e8e57dc could not be found. Jul 31 14:29:56.793634 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:56.793634 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:56.793634 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:56.793634 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:56.793634 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:56.793634 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:56.793634 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:29:56.793634 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:29:56.793634 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6200d587-a817-4a77-b242-ec578e8e57dc could not be found. Jul 31 14:29:56.793634 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:56.794849 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2574d143-e3af-4940-9330-5149b38776d6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Returning 404 to user: Instance 6200d587-a817-4a77-b242-ec578e8e57dc could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:29:56.794849 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2574d143-e3af-4940-9330-5149b38776d6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "DELETE /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 404 len: 111 microversion: 2.20 time: 0.032223 Jul 31 14:29:56.794849 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 446/868] 10.222.0.40 () {60 vars in 1280 bytes} [Sun Jul 31 14:29:56 2022] DELETE /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 14:29:56.800096 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-064807e0-e07f-400c-8334-819ace282552 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:56.800704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-064807e0-e07f-400c-8334-819ace282552 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: 6200d587-a817-4a77-b242-ec578e8e57dc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:56.807635 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-064807e0-e07f-400c-8334-819ace282552 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:56.808083 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-064807e0-e07f-400c-8334-819ace282552 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:56.808838 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-064807e0-e07f-400c-8334-819ace282552 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:56.809270 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-064807e0-e07f-400c-8334-819ace282552 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:56.822555 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.wsgi [None req-064807e0-e07f-400c-8334-819ace282552 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] HTTP exception thrown: Instance 6200d587-a817-4a77-b242-ec578e8e57dc could not be found. Jul 31 14:29:56.824235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-064807e0-e07f-400c-8334-819ace282552 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Request method failure captured: Jul 31 14:29:56.824235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: request: GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc HTTP/1.1 Jul 31 14:29:56.824235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept: application/json Jul 31 14:29:56.824235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept-Encoding: identity Jul 31 14:29:56.824235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Connection: close Jul 31 14:29:56.824235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Length: 0 Jul 31 14:29:56.824235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Type: application/json Jul 31 14:29:56.824235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Host: 10.222.0.40 Jul 31 14:29:56.824235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Openstack-System-Scope: None Jul 31 14:29:56.824235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: User-Agent: python-urllib3/1.26.10 Jul 31 14:29:56.824235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Auth-Token: gAAAAABi5pBBs2shScHoVtG00dWWTh4-8002n0L0mrPn1eGdaBMS3DhpBfsEI9mDgxa2AQImCzjjFCcdbxLTKChvhAaGdGz-LBQ2Ug9xuiFaDHM-Is8fWpkTMwPzMnujnc1YvJ7kfFW1o7r3Zmcil2Je8fqL9ldp7fVMB7icAZWBLQAFDG5mIbU Jul 31 14:29:56.824235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Id: None Jul 31 14:29:56.824235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Name: None Jul 31 14:29:56.824235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Identity-Status: Confirmed Jul 31 14:29:56.824235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Is-Admin-Project: True Jul 31 14:29:56.824235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 14:29:56.824235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Id: default Jul 31 14:29:56.824235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Name: Default Jul 31 14:29:56.824235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Id: ae629f9940d446f2ab39e9a49b3f4753 Jul 31 14:29:56.824235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2143433277 Jul 31 14:29:56.824235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Role: reader,member Jul 31 14:29:56.824235 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Roles: reader,member Jul 31 14:29:56.826106 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ae629f9940d446f2ab39e9a49b3f4753"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ae629f9940d446f2ab39e9a49b3f4753", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ae629f9940d446f2ab39e9a49b3f4753"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ae629f9940d446f2ab39e9a49b3f4753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:29:56.826106 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2143433277 Jul 31 14:29:56.826106 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Id: ae629f9940d446f2ab39e9a49b3f4753 Jul 31 14:29:56.826106 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2143433277 Jul 31 14:29:56.826106 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User: tempest-AttachVolumeShelveTestJSON-2143433277-project Jul 31 14:29:56.826106 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Id: default Jul 31 14:29:56.826106 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Name: Default Jul 31 14:29:56.826106 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Id: 53dab2ec3f2e4973893fb838c3d1d545 Jul 31 14:29:56.826106 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2143433277-project Jul 31 14:29:56.826106 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: method: > Jul 31 14:29:56.826106 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: exception: Instance 6200d587-a817-4a77-b242-ec578e8e57dc could not be found. Jul 31 14:29:56.826106 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: action_args: {'id': '6200d587-a817-4a77-b242-ec578e8e57dc'} Jul 31 14:29:56.826936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:29:56.826936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:56.826936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:29:56.826936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:29:56.826936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:29:56.826936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:29:56.826936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:29:56.826936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:29:56.826936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:29:56.826936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:29:56.826936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6200d587-a817-4a77-b242-ec578e8e57dc could not be found. Jul 31 14:29:56.826936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:56.826936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:56.826936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:56.826936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:56.826936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:56.826936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:56.826936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:29:56.826936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:29:56.826936 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:29:56.828201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:29:56.828201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:29:56.828201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:29:56.828201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:29:56.828201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:29:56.828201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:29:56.828201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:29:56.828201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6200d587-a817-4a77-b242-ec578e8e57dc could not be found. Jul 31 14:29:56.828201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:56.828201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:56.828201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:56.828201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:56.828201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:56.828201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:56.828201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:29:56.828201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:29:56.828201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6200d587-a817-4a77-b242-ec578e8e57dc could not be found. Jul 31 14:29:56.828201 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:56.829341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-064807e0-e07f-400c-8334-819ace282552 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Returning 404 to user: Instance 6200d587-a817-4a77-b242-ec578e8e57dc could not be found. {{(pid=117781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:29:56.829341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-064807e0-e07f-400c-8334-819ace282552 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc" status: 404 len: 111 microversion: 2.20 time: 0.029586 Jul 31 14:29:56.829341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 423/869] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:29:56 2022] GET /compute/v2.1/servers/6200d587-a817-4a77-b242-ec578e8e57dc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 31 14:29:57.962455 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3839250e-6a1d-45e2-811c-2789d7939ac6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:57.962835 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3839250e-6a1d-45e2-811c-2789d7939ac6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:57.969170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3839250e-6a1d-45e2-811c-2789d7939ac6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:57.969614 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3839250e-6a1d-45e2-811c-2789d7939ac6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:57.971049 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3839250e-6a1d-45e2-811c-2789d7939ac6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:57.971507 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3839250e-6a1d-45e2-811c-2789d7939ac6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:57.984405 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-3839250e-6a1d-45e2-811c-2789d7939ac6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] HTTP exception thrown: Instance d0810b36-49ee-482b-9e65-f587148b2a81 could not be found. Jul 31 14:29:57.986122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3839250e-6a1d-45e2-811c-2789d7939ac6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Request method failure captured: Jul 31 14:29:57.986122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: DELETE /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 HTTP/1.1 Jul 31 14:29:57.986122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:29:57.986122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:29:57.986122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:29:57.986122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:29:57.986122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:29:57.986122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:29:57.986122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:29:57.986122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:29:57.986122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pBBs2shScHoVtG00dWWTh4-8002n0L0mrPn1eGdaBMS3DhpBfsEI9mDgxa2AQImCzjjFCcdbxLTKChvhAaGdGz-LBQ2Ug9xuiFaDHM-Is8fWpkTMwPzMnujnc1YvJ7kfFW1o7r3Zmcil2Je8fqL9ldp7fVMB7icAZWBLQAFDG5mIbU Jul 31 14:29:57.986122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:29:57.986122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:29:57.986122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:29:57.986122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:29:57.986122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 14:29:57.986122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:29:57.986122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:29:57.986122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: ae629f9940d446f2ab39e9a49b3f4753 Jul 31 14:29:57.986122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2143433277 Jul 31 14:29:57.986122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:29:57.986122 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:29:57.987791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ae629f9940d446f2ab39e9a49b3f4753"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ae629f9940d446f2ab39e9a49b3f4753", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ae629f9940d446f2ab39e9a49b3f4753"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ae629f9940d446f2ab39e9a49b3f4753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:29:57.987791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2143433277 Jul 31 14:29:57.987791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: ae629f9940d446f2ab39e9a49b3f4753 Jul 31 14:29:57.987791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2143433277 Jul 31 14:29:57.987791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeShelveTestJSON-2143433277-project Jul 31 14:29:57.987791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:29:57.987791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:29:57.987791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: 53dab2ec3f2e4973893fb838c3d1d545 Jul 31 14:29:57.987791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2143433277-project Jul 31 14:29:57.987791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:29:57.987791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance d0810b36-49ee-482b-9e65-f587148b2a81 could not be found. Jul 31 14:29:57.987791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': 'd0810b36-49ee-482b-9e65-f587148b2a81'} Jul 31 14:29:57.988678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:29:57.988678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:57.988678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:29:57.988678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:29:57.988678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:29:57.988678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:29:57.988678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:29:57.988678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:29:57.988678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:29:57.988678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:29:57.988678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0810b36-49ee-482b-9e65-f587148b2a81 could not be found. Jul 31 14:29:57.988678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:57.988678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:57.988678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:57.988678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:57.988678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:57.988678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:57.988678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:29:57.988678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:29:57.988678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:29:57.990127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:29:57.990127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 14:29:57.990127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 14:29:57.990127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 14:29:57.990127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 14:29:57.990127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:29:57.990127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:29:57.990127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:29:57.990127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:29:57.990127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0810b36-49ee-482b-9e65-f587148b2a81 could not be found. Jul 31 14:29:57.990127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:57.990127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:57.990127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:57.990127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:57.990127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:57.990127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:57.990127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:29:57.990127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:29:57.990127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0810b36-49ee-482b-9e65-f587148b2a81 could not be found. Jul 31 14:29:57.990127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:29:57.991713 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3839250e-6a1d-45e2-811c-2789d7939ac6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Returning 404 to user: Instance d0810b36-49ee-482b-9e65-f587148b2a81 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:29:57.991713 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3839250e-6a1d-45e2-811c-2789d7939ac6 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "DELETE /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 404 len: 111 microversion: 2.20 time: 0.029060 Jul 31 14:29:57.991713 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 447/870] 10.222.0.40 () {60 vars in 1280 bytes} [Sun Jul 31 14:29:57 2022] DELETE /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 14:29:57.995867 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-26794c37-9b63-4fb3-9dd3-7b4ed7618485 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:29:57.996468 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-26794c37-9b63-4fb3-9dd3-7b4ed7618485 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] [instance: d0810b36-49ee-482b-9e65-f587148b2a81] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:29:58.002858 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-26794c37-9b63-4fb3-9dd3-7b4ed7618485 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:58.003301 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-26794c37-9b63-4fb3-9dd3-7b4ed7618485 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:58.004085 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-26794c37-9b63-4fb3-9dd3-7b4ed7618485 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:29:58.004517 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-26794c37-9b63-4fb3-9dd3-7b4ed7618485 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:29:58.017750 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.wsgi [None req-26794c37-9b63-4fb3-9dd3-7b4ed7618485 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] HTTP exception thrown: Instance d0810b36-49ee-482b-9e65-f587148b2a81 could not be found. Jul 31 14:29:58.019273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-26794c37-9b63-4fb3-9dd3-7b4ed7618485 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Request method failure captured: Jul 31 14:29:58.019273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: request: GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 HTTP/1.1 Jul 31 14:29:58.019273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept: application/json Jul 31 14:29:58.019273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept-Encoding: identity Jul 31 14:29:58.019273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Connection: close Jul 31 14:29:58.019273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Length: 0 Jul 31 14:29:58.019273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Type: application/json Jul 31 14:29:58.019273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Host: 10.222.0.40 Jul 31 14:29:58.019273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Openstack-System-Scope: None Jul 31 14:29:58.019273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: User-Agent: python-urllib3/1.26.10 Jul 31 14:29:58.019273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Auth-Token: gAAAAABi5pBBs2shScHoVtG00dWWTh4-8002n0L0mrPn1eGdaBMS3DhpBfsEI9mDgxa2AQImCzjjFCcdbxLTKChvhAaGdGz-LBQ2Ug9xuiFaDHM-Is8fWpkTMwPzMnujnc1YvJ7kfFW1o7r3Zmcil2Je8fqL9ldp7fVMB7icAZWBLQAFDG5mIbU Jul 31 14:29:58.019273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Id: None Jul 31 14:29:58.019273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Name: None Jul 31 14:29:58.019273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Identity-Status: Confirmed Jul 31 14:29:58.019273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Is-Admin-Project: True Jul 31 14:29:58.019273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Openstack-Nova-Api-Version: 2.20 Jul 31 14:29:58.019273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Id: default Jul 31 14:29:58.019273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Name: Default Jul 31 14:29:58.019273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Id: ae629f9940d446f2ab39e9a49b3f4753 Jul 31 14:29:58.019273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2143433277 Jul 31 14:29:58.019273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Role: reader,member Jul 31 14:29:58.019273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Roles: reader,member Jul 31 14:29:58.020944 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ae629f9940d446f2ab39e9a49b3f4753"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_ae629f9940d446f2ab39e9a49b3f4753", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/ae629f9940d446f2ab39e9a49b3f4753"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/ae629f9940d446f2ab39e9a49b3f4753"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:29:58.020944 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2143433277 Jul 31 14:29:58.020944 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Id: ae629f9940d446f2ab39e9a49b3f4753 Jul 31 14:29:58.020944 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2143433277 Jul 31 14:29:58.020944 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User: tempest-AttachVolumeShelveTestJSON-2143433277-project Jul 31 14:29:58.020944 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Id: default Jul 31 14:29:58.020944 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Name: Default Jul 31 14:29:58.020944 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Id: 53dab2ec3f2e4973893fb838c3d1d545 Jul 31 14:29:58.020944 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2143433277-project Jul 31 14:29:58.020944 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: method: > Jul 31 14:29:58.020944 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: exception: Instance d0810b36-49ee-482b-9e65-f587148b2a81 could not be found. Jul 31 14:29:58.020944 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: action_args: {'id': 'd0810b36-49ee-482b-9e65-f587148b2a81'} Jul 31 14:29:58.021757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:29:58.021757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:58.021757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:29:58.021757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:29:58.021757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:29:58.021757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:29:58.021757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:29:58.021757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:29:58.021757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:29:58.021757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:29:58.021757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0810b36-49ee-482b-9e65-f587148b2a81 could not be found. Jul 31 14:29:58.021757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:58.021757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:58.021757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:58.021757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:58.021757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:58.021757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:58.021757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:29:58.021757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:29:58.021757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:29:58.023177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:29:58.023177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:29:58.023177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:29:58.023177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:29:58.023177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:29:58.023177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:29:58.023177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:29:58.023177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0810b36-49ee-482b-9e65-f587148b2a81 could not be found. Jul 31 14:29:58.023177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:58.023177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:29:58.023177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:58.023177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:29:58.023177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:29:58.023177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:29:58.023177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:29:58.023177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:29:58.023177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0810b36-49ee-482b-9e65-f587148b2a81 could not be found. Jul 31 14:29:58.023177 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:29:58.024485 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-26794c37-9b63-4fb3-9dd3-7b4ed7618485 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] Returning 404 to user: Instance d0810b36-49ee-482b-9e65-f587148b2a81 could not be found. {{(pid=117781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:29:58.024485 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-26794c37-9b63-4fb3-9dd3-7b4ed7618485 tempest-AttachVolumeShelveTestJSON-2143433277 tempest-AttachVolumeShelveTestJSON-2143433277-project] 10.222.0.40 "GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81" status: 404 len: 111 microversion: 2.20 time: 0.028541 Jul 31 14:29:58.024485 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 424/871] 10.222.0.40 () {60 vars in 1277 bytes} [Sun Jul 31 14:29:57 2022] GET /compute/v2.1/servers/d0810b36-49ee-482b-9e65-f587148b2a81 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 31 14:30:07.142509 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ba84268c-3ea5-4969-a3e9-adf6d6537f11 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Action: 'create', calling method: .version_select at 0x7f87e9899280>, body: {"keypair": {"name": "tempest-keypair-148188395", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjyKrMAphnGflmeQhR6WrlhnYPlErEE8BNd4tOP+g6VM+PzjCeFQCQQpRIFBhTZaFAuGmAhg1BN4Qtwwuke31LqJRt6mgLnX8NTvKaz8MH24qWpL7Pk/O2h48/QYkyIMQ=="}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:30:07.197999 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-ba84268c-3ea5-4969-a3e9-adf6d6537f11 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Getting quotas for project 1eec425dcc93489d9db53600cb95458d. Resources: {'key_pairs'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:30:07.202705 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-ba84268c-3ea5-4969-a3e9-adf6d6537f11 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Getting quotas for user 1d69118a87374b14b0f85a23979d5264 and project 1eec425dcc93489d9db53600cb95458d. Resources: {'key_pairs'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:30:07.246196 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ba84268c-3ea5-4969-a3e9-adf6d6537f11 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.247508 Jul 31 14:30:07.246792 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 448/872] 10.222.0.40 () {60 vars in 1159 bytes} [Sun Jul 31 14:30:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:30:08.823619 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-ea8c93bb-d462-475d-9695-17f9b581209e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-327672872", "imageRef": "57bc051a-64d0-4317-aa93-a7a2aed39369", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c278ad5-3c57-484f-8e61-b722cfb0d058"}], "security_groups": [{"name": "tempest-securitygroup--1911443232"}], "key_name": "tempest-keypair-148188395", "user_data": "}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:30:08.832376 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:30:08.833089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:30:08.973347 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.network.neutron [None req-ea8c93bb-d462-475d-9695-17f9b581209e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] validate_networks() for [('8c278ad5-3c57-484f-8e61-b722cfb0d058', None, None, None, None, None)] {{(pid=117781) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 14:30:09.385384 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-ea8c93bb-d462-475d-9695-17f9b581209e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Flavor limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 14:30:09.385844 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-ea8c93bb-d462-475d-9695-17f9b581209e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Image limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 14:30:09.386317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-ea8c93bb-d462-475d-9695-17f9b581209e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Flavor pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 14:30:09.386866 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-ea8c93bb-d462-475d-9695-17f9b581209e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Image pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 14:30:09.387284 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-ea8c93bb-d462-475d-9695-17f9b581209e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 14:30:09.400447 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ea8c93bb-d462-475d-9695-17f9b581209e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:09.401270 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ea8c93bb-d462-475d-9695-17f9b581209e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:09.402467 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ea8c93bb-d462-475d-9695-17f9b581209e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:09.403857 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ea8c93bb-d462-475d-9695-17f9b581209e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:09.426763 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-ea8c93bb-d462-475d-9695-17f9b581209e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Getting quotas for project 1eec425dcc93489d9db53600cb95458d. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:30:09.431519 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-ea8c93bb-d462-475d-9695-17f9b581209e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Getting quotas for user 1d69118a87374b14b0f85a23979d5264 and project 1eec425dcc93489d9db53600cb95458d. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:30:09.445747 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-ea8c93bb-d462-475d-9695-17f9b581209e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Going to run 1 instances... {{(pid=117781) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 14:30:09.448149 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-ea8c93bb-d462-475d-9695-17f9b581209e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57bc051a-64d0-4317-aa93-a7a2aed39369',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117781) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 14:30:09.497404 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-ea8c93bb-d462-475d-9695-17f9b581209e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.678236 Jul 31 14:30:09.498580 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 425/873] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Jul 31 14:30:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 14:30:09.506151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=26 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:30:09.511760 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-41e746cd-9187-4ae0-9a40-7f1474f3973b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:30:09.512567 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-41e746cd-9187-4ae0-9a40-7f1474f3973b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:30:09.579947 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-41e746cd-9187-4ae0-9a40-7f1474f3973b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:30:09.587443 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-41e746cd-9187-4ae0-9a40-7f1474f3973b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1236 microversion: 2.1 time: 0.082027 Jul 31 14:30:09.588768 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 449/874] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:30:09 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1236 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:30:10.609577 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-62e3d620-7c52-490c-9763-d16d92665cb0 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:30:10.611354 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-62e3d620-7c52-490c-9763-d16d92665cb0 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:30:10.624273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-62e3d620-7c52-490c-9763-d16d92665cb0 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:10.625159 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-62e3d620-7c52-490c-9763-d16d92665cb0 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:10.626170 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-62e3d620-7c52-490c-9763-d16d92665cb0 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:10.626764 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-62e3d620-7c52-490c-9763-d16d92665cb0 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:10.706205 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-62e3d620-7c52-490c-9763-d16d92665cb0 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:30:10.719378 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-62e3d620-7c52-490c-9763-d16d92665cb0 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1296 microversion: 2.1 time: 0.113873 Jul 31 14:30:10.721849 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 426/875] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:30:10 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1296 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:30:11.743001 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-24762d7e-4547-4ea5-8391-e70d640189e9 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:30:11.743943 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-24762d7e-4547-4ea5-8391-e70d640189e9 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:30:11.755147 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-24762d7e-4547-4ea5-8391-e70d640189e9 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:11.758403 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-24762d7e-4547-4ea5-8391-e70d640189e9 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:11.759515 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-24762d7e-4547-4ea5-8391-e70d640189e9 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:11.761593 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-24762d7e-4547-4ea5-8391-e70d640189e9 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:11.939394 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-24762d7e-4547-4ea5-8391-e70d640189e9 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:30:11.947587 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-24762d7e-4547-4ea5-8391-e70d640189e9 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1362 microversion: 2.1 time: 0.209219 Jul 31 14:30:11.948151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 450/876] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:30:11 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:30:12.159757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-30176181-ea11-4f58-805c-dec1ea3c8256 req-d8456651-4f89-4fe7-b2b8-3694cf6ca585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "942db3cc-e948-4ef3-9dd1-381f74a0bbad", "tag": "ee3d38d3-7bf3-4165-afbd-947c828cab7f"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:30:12.171525 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-30176181-ea11-4f58-805c-dec1ea3c8256 req-d8456651-4f89-4fe7-b2b8-3694cf6ca585 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:12.172029 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-30176181-ea11-4f58-805c-dec1ea3c8256 req-d8456651-4f89-4fe7-b2b8-3694cf6ca585 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:12.184667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-30176181-ea11-4f58-805c-dec1ea3c8256 req-d8456651-4f89-4fe7-b2b8-3694cf6ca585 service nova] Creating event network-changed:ee3d38d3-7bf3-4165-afbd-947c828cab7f for instance 942db3cc-e948-4ef3-9dd1-381f74a0bbad on hv-cinder-84984 Jul 31 14:30:12.189852 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-30176181-ea11-4f58-805c-dec1ea3c8256 req-d8456651-4f89-4fe7-b2b8-3694cf6ca585 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035918 Jul 31 14:30:12.190753 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 427/877] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:30:12.969086 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-db94db44-98fc-4c45-b94e-17157ff9c3d1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:30:12.971971 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-db94db44-98fc-4c45-b94e-17157ff9c3d1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:30:12.980235 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-db94db44-98fc-4c45-b94e-17157ff9c3d1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:12.980707 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-db94db44-98fc-4c45-b94e-17157ff9c3d1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:12.981469 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-db94db44-98fc-4c45-b94e-17157ff9c3d1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:12.981911 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-db94db44-98fc-4c45-b94e-17157ff9c3d1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:13.115203 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-db94db44-98fc-4c45-b94e-17157ff9c3d1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:30:13.122602 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-db94db44-98fc-4c45-b94e-17157ff9c3d1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1362 microversion: 2.1 time: 0.157423 Jul 31 14:30:13.123114 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 451/878] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:30:12 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:30:14.145310 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-116af8c8-2ab2-4ab0-88d7-054018f303b6 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:30:14.145993 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-116af8c8-2ab2-4ab0-88d7-054018f303b6 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:30:14.160861 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-116af8c8-2ab2-4ab0-88d7-054018f303b6 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:14.161316 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-116af8c8-2ab2-4ab0-88d7-054018f303b6 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:14.162095 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-116af8c8-2ab2-4ab0-88d7-054018f303b6 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:14.162535 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-116af8c8-2ab2-4ab0-88d7-054018f303b6 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:14.293853 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-116af8c8-2ab2-4ab0-88d7-054018f303b6 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:30:14.301316 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-116af8c8-2ab2-4ab0-88d7-054018f303b6 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1362 microversion: 2.1 time: 0.160736 Jul 31 14:30:14.301947 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 428/879] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:30:14 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:30:15.322401 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3871cd3a-3835-41ee-8e99-0427eddcdcfa tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:30:15.323024 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3871cd3a-3835-41ee-8e99-0427eddcdcfa tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:30:15.329385 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3871cd3a-3835-41ee-8e99-0427eddcdcfa tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:15.329840 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3871cd3a-3835-41ee-8e99-0427eddcdcfa tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:15.330605 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3871cd3a-3835-41ee-8e99-0427eddcdcfa tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:15.331044 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-3871cd3a-3835-41ee-8e99-0427eddcdcfa tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:15.461120 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3871cd3a-3835-41ee-8e99-0427eddcdcfa tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:30:15.470591 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3871cd3a-3835-41ee-8e99-0427eddcdcfa tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1362 microversion: 2.1 time: 0.152337 Jul 31 14:30:15.471154 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 452/880] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:30:15 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:30:16.497388 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-0c6c3371-1f0d-4a3e-9a6a-1f756c618e6c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:30:16.498001 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-0c6c3371-1f0d-4a3e-9a6a-1f756c618e6c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:30:16.504437 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0c6c3371-1f0d-4a3e-9a6a-1f756c618e6c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:16.504891 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0c6c3371-1f0d-4a3e-9a6a-1f756c618e6c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:16.505660 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0c6c3371-1f0d-4a3e-9a6a-1f756c618e6c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:16.506098 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-0c6c3371-1f0d-4a3e-9a6a-1f756c618e6c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:16.638102 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-0c6c3371-1f0d-4a3e-9a6a-1f756c618e6c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:30:16.645981 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-0c6c3371-1f0d-4a3e-9a6a-1f756c618e6c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1362 microversion: 2.1 time: 0.152496 Jul 31 14:30:16.646514 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 429/881] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:30:16 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:30:17.667495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d0f4d8ae-3e69-4aa8-83a6-d60eea249853 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:30:17.668161 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d0f4d8ae-3e69-4aa8-83a6-d60eea249853 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:30:17.670497 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:30:17.675928 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d0f4d8ae-3e69-4aa8-83a6-d60eea249853 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:17.676377 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d0f4d8ae-3e69-4aa8-83a6-d60eea249853 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:17.677138 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d0f4d8ae-3e69-4aa8-83a6-d60eea249853 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:17.677578 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d0f4d8ae-3e69-4aa8-83a6-d60eea249853 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:17.807879 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-d0f4d8ae-3e69-4aa8-83a6-d60eea249853 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:30:17.815725 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d0f4d8ae-3e69-4aa8-83a6-d60eea249853 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1362 microversion: 2.1 time: 0.152167 Jul 31 14:30:17.816291 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 453/882] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:30:17 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:30:18.837211 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-38d114f0-7322-4f88-834b-aa48e8d6faf8 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:30:18.837829 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-38d114f0-7322-4f88-834b-aa48e8d6faf8 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:30:18.844305 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-38d114f0-7322-4f88-834b-aa48e8d6faf8 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:18.844759 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-38d114f0-7322-4f88-834b-aa48e8d6faf8 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:18.845522 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-38d114f0-7322-4f88-834b-aa48e8d6faf8 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:18.845960 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-38d114f0-7322-4f88-834b-aa48e8d6faf8 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:18.973233 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-38d114f0-7322-4f88-834b-aa48e8d6faf8 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:30:18.981102 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-38d114f0-7322-4f88-834b-aa48e8d6faf8 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1362 microversion: 2.1 time: 0.147812 Jul 31 14:30:18.981734 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 430/883] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:30:18 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:30:20.003485 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c4a08e36-3a71-4d85-8997-76628ea20b06 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:30:20.004095 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c4a08e36-3a71-4d85-8997-76628ea20b06 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:30:20.006367 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=6 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:30:20.011590 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c4a08e36-3a71-4d85-8997-76628ea20b06 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:20.012039 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c4a08e36-3a71-4d85-8997-76628ea20b06 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:20.012795 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c4a08e36-3a71-4d85-8997-76628ea20b06 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:20.013227 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c4a08e36-3a71-4d85-8997-76628ea20b06 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:20.142476 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c4a08e36-3a71-4d85-8997-76628ea20b06 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:30:20.150317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c4a08e36-3a71-4d85-8997-76628ea20b06 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1362 microversion: 2.1 time: 0.151231 Jul 31 14:30:20.150929 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 454/884] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:30:19 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:30:21.171387 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7bf15277-afc2-454b-94ce-784148728c46 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:30:21.172090 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7bf15277-afc2-454b-94ce-784148728c46 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:30:21.174002 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:30:21.174809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=6 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:30:21.180771 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7bf15277-afc2-454b-94ce-784148728c46 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:21.181221 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7bf15277-afc2-454b-94ce-784148728c46 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:21.181981 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7bf15277-afc2-454b-94ce-784148728c46 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:21.182415 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7bf15277-afc2-454b-94ce-784148728c46 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:21.310996 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7bf15277-afc2-454b-94ce-784148728c46 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:30:21.318302 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7bf15277-afc2-454b-94ce-784148728c46 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1362 microversion: 2.1 time: 0.150844 Jul 31 14:30:21.318859 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 431/885] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:30:21 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:30:22.339922 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c5d1d768-d1dc-4443-be5b-d8781b08d395 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:30:22.340535 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c5d1d768-d1dc-4443-be5b-d8781b08d395 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:30:22.347592 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c5d1d768-d1dc-4443-be5b-d8781b08d395 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:22.348048 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c5d1d768-d1dc-4443-be5b-d8781b08d395 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:22.348810 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c5d1d768-d1dc-4443-be5b-d8781b08d395 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:22.349247 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c5d1d768-d1dc-4443-be5b-d8781b08d395 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:22.478269 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c5d1d768-d1dc-4443-be5b-d8781b08d395 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:30:22.486427 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c5d1d768-d1dc-4443-be5b-d8781b08d395 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1362 microversion: 2.1 time: 0.150350 Jul 31 14:30:22.486992 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 455/886] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:30:22 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:30:23.507782 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-3ee670d1-9617-4cd3-a92c-fe483f69cc16 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:30:23.508339 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-3ee670d1-9617-4cd3-a92c-fe483f69cc16 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:30:23.514873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3ee670d1-9617-4cd3-a92c-fe483f69cc16 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:23.515329 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3ee670d1-9617-4cd3-a92c-fe483f69cc16 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:23.516134 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3ee670d1-9617-4cd3-a92c-fe483f69cc16 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:23.516580 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3ee670d1-9617-4cd3-a92c-fe483f69cc16 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:23.644371 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-3ee670d1-9617-4cd3-a92c-fe483f69cc16 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:30:23.651808 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-3ee670d1-9617-4cd3-a92c-fe483f69cc16 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1362 microversion: 2.1 time: 0.148020 Jul 31 14:30:23.652376 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 432/887] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:30:23 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:30:24.136630 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-1496431c-33b9-46f1-8c6b-1d751ed57f74 req-781377f6-1a8a-4489-8205-03d882eb6850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942db3cc-e948-4ef3-9dd1-381f74a0bbad", "name": "network-vif-plugged", "status": "completed", "tag": "ee3d38d3-7bf3-4165-afbd-947c828cab7f"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:30:24.147476 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-1496431c-33b9-46f1-8c6b-1d751ed57f74 req-781377f6-1a8a-4489-8205-03d882eb6850 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:24.147695 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-1496431c-33b9-46f1-8c6b-1d751ed57f74 req-781377f6-1a8a-4489-8205-03d882eb6850 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:24.163434 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-1496431c-33b9-46f1-8c6b-1d751ed57f74 req-781377f6-1a8a-4489-8205-03d882eb6850 service nova] Creating event network-vif-plugged:ee3d38d3-7bf3-4165-afbd-947c828cab7f for instance 942db3cc-e948-4ef3-9dd1-381f74a0bbad on hv-cinder-84984 Jul 31 14:30:24.168450 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-1496431c-33b9-46f1-8c6b-1d751ed57f74 req-781377f6-1a8a-4489-8205-03d882eb6850 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040596 Jul 31 14:30:24.169272 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 456/888] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:30:24.673186 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-9ceeb57c-67e0-4947-9559-806f7cdeb574 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:30:24.673798 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-9ceeb57c-67e0-4947-9559-806f7cdeb574 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:30:24.680301 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9ceeb57c-67e0-4947-9559-806f7cdeb574 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:24.680750 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9ceeb57c-67e0-4947-9559-806f7cdeb574 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:24.681510 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9ceeb57c-67e0-4947-9559-806f7cdeb574 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:24.681951 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9ceeb57c-67e0-4947-9559-806f7cdeb574 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:24.816036 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-9ceeb57c-67e0-4947-9559-806f7cdeb574 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:30:24.825355 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-9ceeb57c-67e0-4947-9559-806f7cdeb574 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1362 microversion: 2.1 time: 0.155407 Jul 31 14:30:24.826421 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 433/889] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:30:24 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:30:25.848862 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7243295c-6780-47ac-af1f-d8c974919e28 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:30:25.849553 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7243295c-6780-47ac-af1f-d8c974919e28 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:30:25.857833 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7243295c-6780-47ac-af1f-d8c974919e28 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:25.858283 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7243295c-6780-47ac-af1f-d8c974919e28 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:25.859054 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7243295c-6780-47ac-af1f-d8c974919e28 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:25.859580 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7243295c-6780-47ac-af1f-d8c974919e28 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:25.992770 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7243295c-6780-47ac-af1f-d8c974919e28 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:30:26.000796 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7243295c-6780-47ac-af1f-d8c974919e28 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1548 microversion: 2.1 time: 0.157442 Jul 31 14:30:26.001367 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 457/890] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:30:25 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:30:26.022670 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-378b3d33-5862-487f-8db6-2767978d807b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:30:26.023179 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-378b3d33-5862-487f-8db6-2767978d807b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:30:26.029767 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-378b3d33-5862-487f-8db6-2767978d807b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:26.030160 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-378b3d33-5862-487f-8db6-2767978d807b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:26.030991 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-378b3d33-5862-487f-8db6-2767978d807b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:26.032781 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-378b3d33-5862-487f-8db6-2767978d807b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:26.109157 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-378b3d33-5862-487f-8db6-2767978d807b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090350 Jul 31 14:30:26.109856 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 434/891] 10.222.0.40 () {58 vars in 1275 bytes} [Sun Jul 31 14:30:26 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:30:27.299461 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-3d5ded3e-6d5d-4f64-9382-d2062f3b0cd4 req-150d4fa7-cd70-4d3e-81e2-ea4b0435c4e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "942db3cc-e948-4ef3-9dd1-381f74a0bbad", "tag": "ee3d38d3-7bf3-4165-afbd-947c828cab7f"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:30:27.309388 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-3d5ded3e-6d5d-4f64-9382-d2062f3b0cd4 req-150d4fa7-cd70-4d3e-81e2-ea4b0435c4e5 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:30:27.309831 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-3d5ded3e-6d5d-4f64-9382-d2062f3b0cd4 req-150d4fa7-cd70-4d3e-81e2-ea4b0435c4e5 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:30:27.320737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-3d5ded3e-6d5d-4f64-9382-d2062f3b0cd4 req-150d4fa7-cd70-4d3e-81e2-ea4b0435c4e5 service nova] Creating event network-changed:ee3d38d3-7bf3-4165-afbd-947c828cab7f for instance 942db3cc-e948-4ef3-9dd1-381f74a0bbad on hv-cinder-84984 Jul 31 14:30:27.326216 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-3d5ded3e-6d5d-4f64-9382-d2062f3b0cd4 req-150d4fa7-cd70-4d3e-81e2-ea4b0435c4e5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030421 Jul 31 14:30:27.326912 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 458/892] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:31:03.294896 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:31:03.295672 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=50 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:31:03.300537 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-2dcc470a-da21-4f5e-bfa3-863daf01fd97 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:03.301026 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-2dcc470a-da21-4f5e-bfa3-863daf01fd97 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:03.308109 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2dcc470a-da21-4f5e-bfa3-863daf01fd97 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:03.308561 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2dcc470a-da21-4f5e-bfa3-863daf01fd97 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:03.309326 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2dcc470a-da21-4f5e-bfa3-863daf01fd97 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:03.309761 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2dcc470a-da21-4f5e-bfa3-863daf01fd97 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:03.335187 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-2dcc470a-da21-4f5e-bfa3-863daf01fd97 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad/ips" status: 200 len: 145 microversion: 2.1 time: 0.042075 Jul 31 14:31:03.335779 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 435/893] 10.222.0.40 () {58 vars in 1248 bytes} [Sun Jul 31 14:31:03 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:31:05.599328 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=11 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:31:05.600099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=46 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:31:05.604542 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-46d939c1-da16-4a64-aad6-348d19cb2a8b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "445e7b83-e943-4788-a8f2-e427aeb7ff9f"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:31:05.606947 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-46d939c1-da16-4a64-aad6-348d19cb2a8b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:05.614012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-46d939c1-da16-4a64-aad6-348d19cb2a8b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:05.614464 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-46d939c1-da16-4a64-aad6-348d19cb2a8b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:05.615230 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-46d939c1-da16-4a64-aad6-348d19cb2a8b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:05.615698 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-46d939c1-da16-4a64-aad6-348d19cb2a8b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:05.880732 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-46d939c1-da16-4a64-aad6-348d19cb2a8b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "POST /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282704 Jul 31 14:31:05.881344 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 459/894] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Jul 31 14:31:05 2022] POST /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:31:13.596439 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-2909453d-51ce-435c-8676-a22234e56c4f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:31:13.599909 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:31:13.601161 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=4 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:31:13.620652 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2909453d-51ce-435c-8676-a22234e56c4f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:13.621357 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2909453d-51ce-435c-8676-a22234e56c4f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:13.712575 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-2909453d-51ce-435c-8676-a22234e56c4f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Going to try to stop instance {{(pid=117781) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 31 14:31:13.810366 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-2909453d-51ce-435c-8676-a22234e56c4f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "POST /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad/action" status: 202 len: 0 microversion: 2.1 time: 0.218566 Jul 31 14:31:13.811774 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 436/895] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Jul 31 14:31:13 2022] POST /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:31:13.825481 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9a606a07-6559-42f1-b6d6-6c453d6f20d3 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:13.826705 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9a606a07-6559-42f1-b6d6-6c453d6f20d3 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:13.841747 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9a606a07-6559-42f1-b6d6-6c453d6f20d3 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:13.842277 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9a606a07-6559-42f1-b6d6-6c453d6f20d3 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:13.850871 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9a606a07-6559-42f1-b6d6-6c453d6f20d3 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:13.851564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9a606a07-6559-42f1-b6d6-6c453d6f20d3 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:14.087664 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9a606a07-6559-42f1-b6d6-6c453d6f20d3 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:14.096823 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9a606a07-6559-42f1-b6d6-6c453d6f20d3 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1722 microversion: 2.1 time: 0.276537 Jul 31 14:31:14.097423 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 460/896] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:13 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:15.129704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-946961e7-83a8-425a-b6ca-54db73499d5f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:15.131060 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-946961e7-83a8-425a-b6ca-54db73499d5f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:15.137710 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-946961e7-83a8-425a-b6ca-54db73499d5f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:15.138274 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-946961e7-83a8-425a-b6ca-54db73499d5f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:15.139166 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-946961e7-83a8-425a-b6ca-54db73499d5f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:15.139858 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-946961e7-83a8-425a-b6ca-54db73499d5f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:15.293334 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-946961e7-83a8-425a-b6ca-54db73499d5f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:15.302516 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-946961e7-83a8-425a-b6ca-54db73499d5f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1722 microversion: 2.1 time: 0.185287 Jul 31 14:31:15.303377 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 437/897] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:15 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:15.482012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c83875ad-52d6-4d5f-9085-da1e32dc321e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Action: 'create', calling method: .version_select at 0x7f87e9899790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1450971051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbyMP7qudDLH9oiuvhNDg2IIjuzrwAZXMjyyAxxKnYD8J/UrdMSSm9OSna9xpMDW99PDUhEFPHtaDHYZX3TUBS2grQ8/s0yQeeO+Sz8Bxntfm6aOzS8FcxHZo1HoiBpWQ=="}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:31:15.503825 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-c83875ad-52d6-4d5f-9085-da1e32dc321e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Getting quotas for project 8561e7f1f3d040e28d5084ebf937e198. Resources: {'key_pairs'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:31:15.503825 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-c83875ad-52d6-4d5f-9085-da1e32dc321e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Getting quotas for user 0bbe35ad557841c581e3b1a4aa272f38 and project 8561e7f1f3d040e28d5084ebf937e198. Resources: {'key_pairs'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:31:15.531826 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c83875ad-52d6-4d5f-9085-da1e32dc321e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.287884 Jul 31 14:31:15.533103 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 461/898] 10.222.0.40 () {60 vars in 1159 bytes} [Sun Jul 31 14:31:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:31:16.324282 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-a280fcbe-e1e3-4ee8-be83-981c7de84d3f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:16.325089 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-a280fcbe-e1e3-4ee8-be83-981c7de84d3f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:16.331902 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a280fcbe-e1e3-4ee8-be83-981c7de84d3f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:16.332343 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a280fcbe-e1e3-4ee8-be83-981c7de84d3f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:16.333300 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a280fcbe-e1e3-4ee8-be83-981c7de84d3f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:16.333737 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a280fcbe-e1e3-4ee8-be83-981c7de84d3f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:16.527117 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a280fcbe-e1e3-4ee8-be83-981c7de84d3f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:16.536380 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-a280fcbe-e1e3-4ee8-be83-981c7de84d3f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1722 microversion: 2.1 time: 0.215962 Jul 31 14:31:16.536943 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 438/899] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:16 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:17.562044 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-041ed92c-7643-4e0e-9c9d-6456b243af39 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:17.562644 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-041ed92c-7643-4e0e-9c9d-6456b243af39 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:17.569391 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-041ed92c-7643-4e0e-9c9d-6456b243af39 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:17.569834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-041ed92c-7643-4e0e-9c9d-6456b243af39 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:17.570584 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-041ed92c-7643-4e0e-9c9d-6456b243af39 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:17.571003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-041ed92c-7643-4e0e-9c9d-6456b243af39 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:17.655704 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 14:31:17.656126 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Sun Jul 31 14:31:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad (ip 10.222.0.40) !!! Jul 31 14:31:17.702973 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-041ed92c-7643-4e0e-9c9d-6456b243af39 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:17.712155 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-041ed92c-7643-4e0e-9c9d-6456b243af39 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1722 microversion: 2.1 time: 0.154485 Jul 31 14:31:17.712738 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 462/900] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:17 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:18.734499 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-ce21ba16-253a-4c18-aff1-63222b48ce88 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:18.735737 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-ce21ba16-253a-4c18-aff1-63222b48ce88 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:18.743448 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ce21ba16-253a-4c18-aff1-63222b48ce88 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:18.744087 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ce21ba16-253a-4c18-aff1-63222b48ce88 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:18.744867 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ce21ba16-253a-4c18-aff1-63222b48ce88 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:18.745311 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ce21ba16-253a-4c18-aff1-63222b48ce88 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:19.180409 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-ce21ba16-253a-4c18-aff1-63222b48ce88 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:19.188920 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-ce21ba16-253a-4c18-aff1-63222b48ce88 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1722 microversion: 2.1 time: 0.458690 Jul 31 14:31:19.189497 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 439/901] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:18 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1722 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:20.210610 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a3745f2b-8205-47bc-96f7-cd4318870411 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:20.211228 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a3745f2b-8205-47bc-96f7-cd4318870411 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:20.217704 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a3745f2b-8205-47bc-96f7-cd4318870411 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:20.218155 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a3745f2b-8205-47bc-96f7-cd4318870411 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:20.218926 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a3745f2b-8205-47bc-96f7-cd4318870411 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:20.219367 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a3745f2b-8205-47bc-96f7-cd4318870411 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:20.364755 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a3745f2b-8205-47bc-96f7-cd4318870411 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:20.372654 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a3745f2b-8205-47bc-96f7-cd4318870411 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1722 microversion: 2.1 time: 0.165921 Jul 31 14:31:20.373228 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 463/902] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:20 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:31:21.396532 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-900f5ba1-9f12-4909-968d-c7af239ad683 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:21.397159 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-900f5ba1-9f12-4909-968d-c7af239ad683 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:21.403745 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-900f5ba1-9f12-4909-968d-c7af239ad683 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:21.404227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-900f5ba1-9f12-4909-968d-c7af239ad683 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:21.405036 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-900f5ba1-9f12-4909-968d-c7af239ad683 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:21.405478 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-900f5ba1-9f12-4909-968d-c7af239ad683 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:21.544528 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-900f5ba1-9f12-4909-968d-c7af239ad683 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:21.553102 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-900f5ba1-9f12-4909-968d-c7af239ad683 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1722 microversion: 2.1 time: 0.160439 Jul 31 14:31:21.553669 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 440/903] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:21 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:22.574147 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-abe11664-9f99-4252-8970-5f4973ce9757 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:22.574673 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-abe11664-9f99-4252-8970-5f4973ce9757 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:22.581501 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-abe11664-9f99-4252-8970-5f4973ce9757 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:22.581945 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-abe11664-9f99-4252-8970-5f4973ce9757 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:22.582708 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-abe11664-9f99-4252-8970-5f4973ce9757 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:22.583159 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-abe11664-9f99-4252-8970-5f4973ce9757 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:22.715230 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-abe11664-9f99-4252-8970-5f4973ce9757 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:22.724609 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-abe11664-9f99-4252-8970-5f4973ce9757 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1722 microversion: 2.1 time: 0.154303 Jul 31 14:31:22.725208 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 464/904] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:22 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:23.746699 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-6fb28e65-7ba6-483e-afd8-7315bb7177e7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:23.747303 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-6fb28e65-7ba6-483e-afd8-7315bb7177e7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:23.754461 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6fb28e65-7ba6-483e-afd8-7315bb7177e7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:23.754917 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6fb28e65-7ba6-483e-afd8-7315bb7177e7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:23.755713 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6fb28e65-7ba6-483e-afd8-7315bb7177e7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:23.756152 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6fb28e65-7ba6-483e-afd8-7315bb7177e7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:23.886877 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-6fb28e65-7ba6-483e-afd8-7315bb7177e7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:23.895500 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-6fb28e65-7ba6-483e-afd8-7315bb7177e7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1722 microversion: 2.1 time: 0.152642 Jul 31 14:31:23.896059 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 441/905] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:23 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:24.917407 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1d6bb819-dadb-4a3b-95f1-ca9c34e66e02 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:24.918029 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1d6bb819-dadb-4a3b-95f1-ca9c34e66e02 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:24.925027 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d6bb819-dadb-4a3b-95f1-ca9c34e66e02 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:24.925482 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d6bb819-dadb-4a3b-95f1-ca9c34e66e02 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:24.926257 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d6bb819-dadb-4a3b-95f1-ca9c34e66e02 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:24.926696 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1d6bb819-dadb-4a3b-95f1-ca9c34e66e02 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:25.058662 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1d6bb819-dadb-4a3b-95f1-ca9c34e66e02 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:25.066591 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1d6bb819-dadb-4a3b-95f1-ca9c34e66e02 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1722 microversion: 2.1 time: 0.153534 Jul 31 14:31:25.067156 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 465/906] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:24 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:26.088441 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-13793e94-a81b-4a2e-8560-f66c8d25338a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:26.089048 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-13793e94-a81b-4a2e-8560-f66c8d25338a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:26.096108 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-13793e94-a81b-4a2e-8560-f66c8d25338a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:26.096554 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-13793e94-a81b-4a2e-8560-f66c8d25338a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:26.097316 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-13793e94-a81b-4a2e-8560-f66c8d25338a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:26.097753 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-13793e94-a81b-4a2e-8560-f66c8d25338a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:26.227688 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-13793e94-a81b-4a2e-8560-f66c8d25338a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:26.236004 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-13793e94-a81b-4a2e-8560-f66c8d25338a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1722 microversion: 2.1 time: 0.151391 Jul 31 14:31:26.236573 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 442/907] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:26 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:27.257230 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-89ea8aa4-7650-4dd5-bc5c-958057c4bad7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:27.257843 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-89ea8aa4-7650-4dd5-bc5c-958057c4bad7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:27.259753 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=4 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:31:27.267079 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-89ea8aa4-7650-4dd5-bc5c-958057c4bad7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:27.267569 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-89ea8aa4-7650-4dd5-bc5c-958057c4bad7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:27.268346 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-89ea8aa4-7650-4dd5-bc5c-958057c4bad7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:27.268821 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-89ea8aa4-7650-4dd5-bc5c-958057c4bad7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:27.399005 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-89ea8aa4-7650-4dd5-bc5c-958057c4bad7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:27.406845 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-89ea8aa4-7650-4dd5-bc5c-958057c4bad7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1722 microversion: 2.1 time: 0.153534 Jul 31 14:31:27.407399 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 466/908] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:27 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:28.427947 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-3d420ddc-ae2c-4874-bc9a-c02a1560b9f0 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:28.428562 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-3d420ddc-ae2c-4874-bc9a-c02a1560b9f0 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:28.435882 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3d420ddc-ae2c-4874-bc9a-c02a1560b9f0 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:28.436338 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3d420ddc-ae2c-4874-bc9a-c02a1560b9f0 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:28.437104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3d420ddc-ae2c-4874-bc9a-c02a1560b9f0 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:28.437552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3d420ddc-ae2c-4874-bc9a-c02a1560b9f0 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:28.574024 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-3d420ddc-ae2c-4874-bc9a-c02a1560b9f0 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:28.582915 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-3d420ddc-ae2c-4874-bc9a-c02a1560b9f0 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1722 microversion: 2.1 time: 0.158871 Jul 31 14:31:28.583787 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 443/909] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:28 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:29.604853 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-618e4c44-2e40-48fe-a0d8-b097fb57a30c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:29.605463 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-618e4c44-2e40-48fe-a0d8-b097fb57a30c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:29.612637 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-618e4c44-2e40-48fe-a0d8-b097fb57a30c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:29.613087 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-618e4c44-2e40-48fe-a0d8-b097fb57a30c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:29.613849 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-618e4c44-2e40-48fe-a0d8-b097fb57a30c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:29.614284 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-618e4c44-2e40-48fe-a0d8-b097fb57a30c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:29.746367 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-618e4c44-2e40-48fe-a0d8-b097fb57a30c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:29.754208 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-618e4c44-2e40-48fe-a0d8-b097fb57a30c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1699 microversion: 2.1 time: 0.153205 Jul 31 14:31:29.754770 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 467/910] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:29 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1699 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:29.774304 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b25d58ba-227f-4019-ac13-d0c4334b2948 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:31:29.780748 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b25d58ba-227f-4019-ac13-d0c4334b2948 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:29.781190 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b25d58ba-227f-4019-ac13-d0c4334b2948 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:29.804041 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b25d58ba-227f-4019-ac13-d0c4334b2948 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Going to try to start instance {{(pid=117781) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 31 14:31:29.843794 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b25d58ba-227f-4019-ac13-d0c4334b2948 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "POST /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad/action" status: 202 len: 0 microversion: 2.1 time: 0.073113 Jul 31 14:31:29.844862 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 444/911] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Jul 31 14:31:29 2022] POST /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:31:29.853205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fd9fe8bc-cb23-4087-96b2-8af9f1d0899c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:29.853943 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fd9fe8bc-cb23-4087-96b2-8af9f1d0899c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:29.861416 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd9fe8bc-cb23-4087-96b2-8af9f1d0899c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:29.861842 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd9fe8bc-cb23-4087-96b2-8af9f1d0899c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:29.862618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd9fe8bc-cb23-4087-96b2-8af9f1d0899c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:29.863709 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd9fe8bc-cb23-4087-96b2-8af9f1d0899c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:30.003126 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fd9fe8bc-cb23-4087-96b2-8af9f1d0899c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:30.012387 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fd9fe8bc-cb23-4087-96b2-8af9f1d0899c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1708 microversion: 2.1 time: 0.162874 Jul 31 14:31:30.015495 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 468/912] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:29 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1708 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:30.830014 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-3ef00195-e83b-4c1d-9803-8083849e6a90 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1480882384", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1450971051", "security_groups": [{"name": "tempest-secgroup-smoke-1991941503"}], "block_device_mapping_v2": [{"uuid": "413bc850-a58d-4140-a40b-612c424e2b39", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4031262c-bbbd-4f7f-958b-e948963cb0b2"}]}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:31:30.945290 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.network.neutron [None req-3ef00195-e83b-4c1d-9803-8083849e6a90 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] validate_networks() for [('4031262c-bbbd-4f7f-958b-e948963cb0b2', None, None, None, None, None)] {{(pid=117781) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 14:31:31.037206 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fd7e4d76-6148-45ef-b4ff-af1dd0fa9564 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:31.037932 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fd7e4d76-6148-45ef-b4ff-af1dd0fa9564 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:31.044576 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd7e4d76-6148-45ef-b4ff-af1dd0fa9564 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:31.045056 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd7e4d76-6148-45ef-b4ff-af1dd0fa9564 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:31.045885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd7e4d76-6148-45ef-b4ff-af1dd0fa9564 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:31.046323 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fd7e4d76-6148-45ef-b4ff-af1dd0fa9564 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:31.177303 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-fd7e4d76-6148-45ef-b4ff-af1dd0fa9564 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:31.185435 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fd7e4d76-6148-45ef-b4ff-af1dd0fa9564 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1712 microversion: 2.1 time: 0.152261 Jul 31 14:31:31.186005 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 469/913] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:31 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1712 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:31:31.314076 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-3ef00195-e83b-4c1d-9803-8083849e6a90 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Flavor limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 14:31:31.314509 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-3ef00195-e83b-4c1d-9803-8083849e6a90 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Image limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 14:31:31.314980 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-3ef00195-e83b-4c1d-9803-8083849e6a90 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Flavor pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 14:31:31.315390 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-3ef00195-e83b-4c1d-9803-8083849e6a90 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Image pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 14:31:31.315821 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-3ef00195-e83b-4c1d-9803-8083849e6a90 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 14:31:31.324608 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3ef00195-e83b-4c1d-9803-8083849e6a90 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:31.325312 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3ef00195-e83b-4c1d-9803-8083849e6a90 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:31.326117 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3ef00195-e83b-4c1d-9803-8083849e6a90 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:31.326558 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3ef00195-e83b-4c1d-9803-8083849e6a90 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:31.342754 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-3ef00195-e83b-4c1d-9803-8083849e6a90 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Getting quotas for project 8561e7f1f3d040e28d5084ebf937e198. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:31:31.347346 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-3ef00195-e83b-4c1d-9803-8083849e6a90 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Getting quotas for user 0bbe35ad557841c581e3b1a4aa272f38 and project 8561e7f1f3d040e28d5084ebf937e198. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:31:31.402754 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-3ef00195-e83b-4c1d-9803-8083849e6a90 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Going to run 1 instances... {{(pid=117781) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 14:31:31.404945 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-3ef00195-e83b-4c1d-9803-8083849e6a90 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='413bc850-a58d-4140-a40b-612c424e2b39',volume_size=None,volume_type=None)] {{(pid=117781) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 14:31:31.537505 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-3ef00195-e83b-4c1d-9803-8083849e6a90 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.712445 Jul 31 14:31:31.538313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 445/914] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Jul 31 14:31:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 14:31:31.548807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-feed104a-46e0-4127-ad8b-8deed3a96b5d tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:31.549419 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-feed104a-46e0-4127-ad8b-8deed3a96b5d tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:31.605699 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-feed104a-46e0-4127-ad8b-8deed3a96b5d tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:31.612496 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-feed104a-46e0-4127-ad8b-8deed3a96b5d tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc" status: 200 len: 1095 microversion: 2.1 time: 0.067532 Jul 31 14:31:31.613066 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 470/915] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:31 2022] GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:32.633625 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-829581fb-83f4-4d40-85df-6f392afd837c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:32.634234 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-829581fb-83f4-4d40-85df-6f392afd837c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:32.640666 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-829581fb-83f4-4d40-85df-6f392afd837c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:32.641120 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-829581fb-83f4-4d40-85df-6f392afd837c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:32.642449 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-829581fb-83f4-4d40-85df-6f392afd837c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:32.642887 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-829581fb-83f4-4d40-85df-6f392afd837c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:32.707524 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-829581fb-83f4-4d40-85df-6f392afd837c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:32.715040 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-829581fb-83f4-4d40-85df-6f392afd837c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc" status: 200 len: 1193 microversion: 2.1 time: 0.085734 Jul 31 14:31:32.715669 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 446/916] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:32 2022] GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:33.736113 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f24dc906-4543-4b7c-a6d4-0566bcd07491 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:33.736723 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f24dc906-4543-4b7c-a6d4-0566bcd07491 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:33.743192 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f24dc906-4543-4b7c-a6d4-0566bcd07491 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:33.743678 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f24dc906-4543-4b7c-a6d4-0566bcd07491 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:33.744448 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f24dc906-4543-4b7c-a6d4-0566bcd07491 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:33.744885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f24dc906-4543-4b7c-a6d4-0566bcd07491 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:33.878692 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f24dc906-4543-4b7c-a6d4-0566bcd07491 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:33.887091 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f24dc906-4543-4b7c-a6d4-0566bcd07491 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc" status: 200 len: 1267 microversion: 2.1 time: 0.154957 Jul 31 14:31:33.888126 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 471/917] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:33 2022] GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:34.096024 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-fad26b23-a59a-4de7-a1c5-65525318587e req-d68e4b4d-58e0-4f41-b540-561d210d1ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34675f3a-4930-453a-9c06-142fabaa0dcc", "tag": "12d3e4ce-529c-4b75-a6d6-c27a4c8b2640"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:31:34.106517 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-fad26b23-a59a-4de7-a1c5-65525318587e req-d68e4b4d-58e0-4f41-b540-561d210d1ac5 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:34.107056 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-fad26b23-a59a-4de7-a1c5-65525318587e req-d68e4b4d-58e0-4f41-b540-561d210d1ac5 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:34.118019 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-fad26b23-a59a-4de7-a1c5-65525318587e req-d68e4b4d-58e0-4f41-b540-561d210d1ac5 service nova] Creating event network-changed:12d3e4ce-529c-4b75-a6d6-c27a4c8b2640 for instance 34675f3a-4930-453a-9c06-142fabaa0dcc on hv-cinder-84984 Jul 31 14:31:34.123376 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-fad26b23-a59a-4de7-a1c5-65525318587e req-d68e4b4d-58e0-4f41-b540-561d210d1ac5 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036453 Jul 31 14:31:34.124285 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 447/918] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:31:34.909153 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-566d6cad-4237-4b69-ae5a-3cc421853c52 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:34.909811 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-566d6cad-4237-4b69-ae5a-3cc421853c52 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:34.916378 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-566d6cad-4237-4b69-ae5a-3cc421853c52 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:34.916943 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-566d6cad-4237-4b69-ae5a-3cc421853c52 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:34.917900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-566d6cad-4237-4b69-ae5a-3cc421853c52 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:34.918445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-566d6cad-4237-4b69-ae5a-3cc421853c52 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:35.050043 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-566d6cad-4237-4b69-ae5a-3cc421853c52 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:35.057639 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-566d6cad-4237-4b69-ae5a-3cc421853c52 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc" status: 200 len: 1267 microversion: 2.1 time: 0.152784 Jul 31 14:31:35.058327 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 472/919] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:34 2022] GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:36.079731 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-c157d148-d75a-468d-b1a4-266b50b896fd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:36.080447 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-c157d148-d75a-468d-b1a4-266b50b896fd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:36.086660 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c157d148-d75a-468d-b1a4-266b50b896fd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:36.087108 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c157d148-d75a-468d-b1a4-266b50b896fd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:36.087903 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c157d148-d75a-468d-b1a4-266b50b896fd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:36.088342 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c157d148-d75a-468d-b1a4-266b50b896fd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:36.215781 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c157d148-d75a-468d-b1a4-266b50b896fd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:36.223174 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-c157d148-d75a-468d-b1a4-266b50b896fd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc" status: 200 len: 1267 microversion: 2.1 time: 0.148502 Jul 31 14:31:36.223779 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 448/920] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:36 2022] GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:37.244297 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ed3d2902-a55e-4383-a8f7-bac775e87170 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:37.244905 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ed3d2902-a55e-4383-a8f7-bac775e87170 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:37.247190 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:31:37.253005 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ed3d2902-a55e-4383-a8f7-bac775e87170 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:37.253466 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ed3d2902-a55e-4383-a8f7-bac775e87170 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:37.254229 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ed3d2902-a55e-4383-a8f7-bac775e87170 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:37.254837 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ed3d2902-a55e-4383-a8f7-bac775e87170 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:37.259885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:31:37.389747 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ed3d2902-a55e-4383-a8f7-bac775e87170 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:37.397716 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ed3d2902-a55e-4383-a8f7-bac775e87170 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc" status: 200 len: 1267 microversion: 2.1 time: 0.157319 Jul 31 14:31:37.398216 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 473/921] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:37 2022] GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:38.418392 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-dac40f07-2804-4729-8d27-e974723cfa9f tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:38.419018 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-dac40f07-2804-4729-8d27-e974723cfa9f tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:38.425410 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dac40f07-2804-4729-8d27-e974723cfa9f tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:38.425853 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dac40f07-2804-4729-8d27-e974723cfa9f tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:38.426603 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dac40f07-2804-4729-8d27-e974723cfa9f tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:38.427034 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dac40f07-2804-4729-8d27-e974723cfa9f tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:38.558205 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-dac40f07-2804-4729-8d27-e974723cfa9f tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:38.566123 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-dac40f07-2804-4729-8d27-e974723cfa9f tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc" status: 200 len: 1267 microversion: 2.1 time: 0.151777 Jul 31 14:31:38.566685 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 449/922] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:38 2022] GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:39.588054 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-81c368d5-a690-4556-8a59-2034bd21d056 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:39.588671 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-81c368d5-a690-4556-8a59-2034bd21d056 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:39.595698 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-81c368d5-a690-4556-8a59-2034bd21d056 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:39.596150 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-81c368d5-a690-4556-8a59-2034bd21d056 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:39.596924 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-81c368d5-a690-4556-8a59-2034bd21d056 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:39.597364 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-81c368d5-a690-4556-8a59-2034bd21d056 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:39.725221 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-81c368d5-a690-4556-8a59-2034bd21d056 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:39.732623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-81c368d5-a690-4556-8a59-2034bd21d056 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc" status: 200 len: 1267 microversion: 2.1 time: 0.148508 Jul 31 14:31:39.733197 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 474/923] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:39 2022] GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:40.752925 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-f6d0b33b-ae48-4347-a337-cf7737c9a8ec tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:40.753552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-f6d0b33b-ae48-4347-a337-cf7737c9a8ec tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:40.760024 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f6d0b33b-ae48-4347-a337-cf7737c9a8ec tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:40.760476 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f6d0b33b-ae48-4347-a337-cf7737c9a8ec tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:40.761236 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f6d0b33b-ae48-4347-a337-cf7737c9a8ec tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:40.761674 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f6d0b33b-ae48-4347-a337-cf7737c9a8ec tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:40.895412 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-f6d0b33b-ae48-4347-a337-cf7737c9a8ec tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:40.903031 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-f6d0b33b-ae48-4347-a337-cf7737c9a8ec tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc" status: 200 len: 1267 microversion: 2.1 time: 0.154552 Jul 31 14:31:40.903662 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 450/924] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:40 2022] GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:41.924025 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9a79e6fd-2317-4cca-a3e9-24df3e8a4f9e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:41.924638 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9a79e6fd-2317-4cca-a3e9-24df3e8a4f9e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:41.926929 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:31:41.932435 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9a79e6fd-2317-4cca-a3e9-24df3e8a4f9e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:41.932882 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9a79e6fd-2317-4cca-a3e9-24df3e8a4f9e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:41.933643 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9a79e6fd-2317-4cca-a3e9-24df3e8a4f9e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:41.934082 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9a79e6fd-2317-4cca-a3e9-24df3e8a4f9e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:42.065719 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9a79e6fd-2317-4cca-a3e9-24df3e8a4f9e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:42.073126 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9a79e6fd-2317-4cca-a3e9-24df3e8a4f9e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc" status: 200 len: 1267 microversion: 2.1 time: 0.153550 Jul 31 14:31:42.073686 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 475/925] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:41 2022] GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:43.093972 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-54a71f0b-17a9-4ebf-ba90-15d939832338 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:43.094590 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-54a71f0b-17a9-4ebf-ba90-15d939832338 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:43.096550 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:31:43.097361 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=6 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:31:43.103845 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-54a71f0b-17a9-4ebf-ba90-15d939832338 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:43.104297 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-54a71f0b-17a9-4ebf-ba90-15d939832338 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:43.105067 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-54a71f0b-17a9-4ebf-ba90-15d939832338 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:43.105681 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-54a71f0b-17a9-4ebf-ba90-15d939832338 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:43.237266 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-54a71f0b-17a9-4ebf-ba90-15d939832338 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:43.240702 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:31:43.245561 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-54a71f0b-17a9-4ebf-ba90-15d939832338 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc" status: 200 len: 1267 microversion: 2.1 time: 0.155653 Jul 31 14:31:43.246125 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 451/926] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:43 2022] GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:44.266118 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a0258af0-b627-48b7-9752-fcc4c18a05aa tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:44.267216 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a0258af0-b627-48b7-9752-fcc4c18a05aa tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:44.273755 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a0258af0-b627-48b7-9752-fcc4c18a05aa tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:44.274155 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a0258af0-b627-48b7-9752-fcc4c18a05aa tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:44.274914 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a0258af0-b627-48b7-9752-fcc4c18a05aa tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:44.275352 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a0258af0-b627-48b7-9752-fcc4c18a05aa tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:44.403618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a0258af0-b627-48b7-9752-fcc4c18a05aa tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:44.411802 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a0258af0-b627-48b7-9752-fcc4c18a05aa tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc" status: 200 len: 1267 microversion: 2.1 time: 0.149518 Jul 31 14:31:44.412373 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 476/927] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:44 2022] GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:44.675890 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-ff3e595a-8d79-4ac3-a3b5-5375657376b4 req-73e1aca4-0c47-4754-a779-5b756689380e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34675f3a-4930-453a-9c06-142fabaa0dcc", "name": "network-vif-plugged", "status": "completed", "tag": "12d3e4ce-529c-4b75-a6d6-c27a4c8b2640"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:31:44.681817 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:31:44.689022 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-ff3e595a-8d79-4ac3-a3b5-5375657376b4 req-73e1aca4-0c47-4754-a779-5b756689380e service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:44.689460 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-ff3e595a-8d79-4ac3-a3b5-5375657376b4 req-73e1aca4-0c47-4754-a779-5b756689380e service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:44.701846 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-ff3e595a-8d79-4ac3-a3b5-5375657376b4 req-73e1aca4-0c47-4754-a779-5b756689380e service nova] Creating event network-vif-plugged:12d3e4ce-529c-4b75-a6d6-c27a4c8b2640 for instance 34675f3a-4930-453a-9c06-142fabaa0dcc on hv-cinder-84984 Jul 31 14:31:44.707378 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-ff3e595a-8d79-4ac3-a3b5-5375657376b4 req-73e1aca4-0c47-4754-a779-5b756689380e service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035341 Jul 31 14:31:44.708056 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 452/928] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:31:45.432733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-28bd07f7-b0d2-4f05-9731-cd20309950ee tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:45.433344 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-28bd07f7-b0d2-4f05-9731-cd20309950ee tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:45.439550 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-28bd07f7-b0d2-4f05-9731-cd20309950ee tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:45.439996 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-28bd07f7-b0d2-4f05-9731-cd20309950ee tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:45.440757 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-28bd07f7-b0d2-4f05-9731-cd20309950ee tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:45.441190 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-28bd07f7-b0d2-4f05-9731-cd20309950ee tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:45.570190 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-28bd07f7-b0d2-4f05-9731-cd20309950ee tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:45.577878 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-28bd07f7-b0d2-4f05-9731-cd20309950ee tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc" status: 200 len: 1267 microversion: 2.1 time: 0.149034 Jul 31 14:31:45.578444 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 477/929] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:45 2022] GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:46.599232 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b3cf4beb-6728-440f-9c9d-6f5272ba26cd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:46.599946 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b3cf4beb-6728-440f-9c9d-6f5272ba26cd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:46.606125 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b3cf4beb-6728-440f-9c9d-6f5272ba26cd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:46.606567 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b3cf4beb-6728-440f-9c9d-6f5272ba26cd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:46.607313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b3cf4beb-6728-440f-9c9d-6f5272ba26cd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:46.607838 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b3cf4beb-6728-440f-9c9d-6f5272ba26cd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:46.737011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-b3cf4beb-6728-440f-9c9d-6f5272ba26cd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:46.744391 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b3cf4beb-6728-440f-9c9d-6f5272ba26cd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc" status: 200 len: 1454 microversion: 2.1 time: 0.149816 Jul 31 14:31:46.744958 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 453/930] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:46 2022] GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:46.764696 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f300ffb3-6c0e-48b6-bdc5-847576de882f tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:31:46.765310 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f300ffb3-6c0e-48b6-bdc5-847576de882f tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:31:46.771739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f300ffb3-6c0e-48b6-bdc5-847576de882f tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:46.772192 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f300ffb3-6c0e-48b6-bdc5-847576de882f tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:46.773175 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f300ffb3-6c0e-48b6-bdc5-847576de882f tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:46.773858 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f300ffb3-6c0e-48b6-bdc5-847576de882f tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:46.906932 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f300ffb3-6c0e-48b6-bdc5-847576de882f tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:31:46.914861 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f300ffb3-6c0e-48b6-bdc5-847576de882f tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc" status: 200 len: 1454 microversion: 2.1 time: 0.154166 Jul 31 14:31:46.915428 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 478/931] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:31:46 2022] GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:31:48.565956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-61592864-71c2-48bb-bcb7-d62b198d0874 req-0deaf89c-2cd1-482a-b4ad-fcba85907f57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34675f3a-4930-453a-9c06-142fabaa0dcc", "tag": "12d3e4ce-529c-4b75-a6d6-c27a4c8b2640"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:31:48.576961 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-61592864-71c2-48bb-bcb7-d62b198d0874 req-0deaf89c-2cd1-482a-b4ad-fcba85907f57 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:31:48.577399 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-61592864-71c2-48bb-bcb7-d62b198d0874 req-0deaf89c-2cd1-482a-b4ad-fcba85907f57 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:31:48.588320 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-61592864-71c2-48bb-bcb7-d62b198d0874 req-0deaf89c-2cd1-482a-b4ad-fcba85907f57 service nova] Creating event network-changed:12d3e4ce-529c-4b75-a6d6-c27a4c8b2640 for instance 34675f3a-4930-453a-9c06-142fabaa0dcc on hv-cinder-84984 Jul 31 14:31:48.593335 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-61592864-71c2-48bb-bcb7-d62b198d0874 req-0deaf89c-2cd1-482a-b4ad-fcba85907f57 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031054 Jul 31 14:31:48.594012 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 454/932] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:32:03.754676 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-fb310ffd-424f-4d76-955f-3154736a73bd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:32:03.755230 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-fb310ffd-424f-4d76-955f-3154736a73bd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:32:03.757765 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=11 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:32:03.758422 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=35 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:32:03.764211 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fb310ffd-424f-4d76-955f-3154736a73bd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:03.764660 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fb310ffd-424f-4d76-955f-3154736a73bd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:03.765417 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fb310ffd-424f-4d76-955f-3154736a73bd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:03.765857 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-fb310ffd-424f-4d76-955f-3154736a73bd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:03.843851 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-fb310ffd-424f-4d76-955f-3154736a73bd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lazy-loading 'services' on Instance uuid 942db3cc-e948-4ef3-9dd1-381f74a0bbad {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:32:03.914845 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-fb310ffd-424f-4d76-955f-3154736a73bd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "DELETE /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad/os-volume_attachments/445e7b83-e943-4788-a8f2-e427aeb7ff9f" status: 202 len: 0 microversion: 2.1 time: 0.164585 Jul 31 14:32:03.915452 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 479/933] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Jul 31 14:32:03 2022] DELETE /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad/os-volume_attachments/445e7b83-e943-4788-a8f2-e427aeb7ff9f => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:32:05.052812 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=5 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:32:05.053541 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=10 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:32:05.058396 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-3bc5681e-630a-437b-bbb6-052ab15968dd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:32:05.066078 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3bc5681e-630a-437b-bbb6-052ab15968dd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:05.066531 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3bc5681e-630a-437b-bbb6-052ab15968dd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:05.088506 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-3bc5681e-630a-437b-bbb6-052ab15968dd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Going to try to stop instance {{(pid=117781) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 31 14:32:05.129784 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-3bc5681e-630a-437b-bbb6-052ab15968dd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "POST /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad/action" status: 202 len: 0 microversion: 2.1 time: 0.078220 Jul 31 14:32:05.130411 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 455/934] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Jul 31 14:32:05 2022] POST /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:32:05.139413 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-87f7dff5-b23e-4813-aeb5-0d21a57d348b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:32:05.145097 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-87f7dff5-b23e-4813-aeb5-0d21a57d348b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:32:05.151710 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-87f7dff5-b23e-4813-aeb5-0d21a57d348b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:05.152170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-87f7dff5-b23e-4813-aeb5-0d21a57d348b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:05.152950 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-87f7dff5-b23e-4813-aeb5-0d21a57d348b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:05.153391 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-87f7dff5-b23e-4813-aeb5-0d21a57d348b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:05.283450 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-87f7dff5-b23e-4813-aeb5-0d21a57d348b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:32:05.291367 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-87f7dff5-b23e-4813-aeb5-0d21a57d348b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1676 microversion: 2.1 time: 0.156610 Jul 31 14:32:05.291970 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 480/935] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:32:05 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:32:06.313855 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-bcc4c12f-15dd-499e-b22e-07d62d42b87f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:32:06.314523 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-bcc4c12f-15dd-499e-b22e-07d62d42b87f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:32:06.320838 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bcc4c12f-15dd-499e-b22e-07d62d42b87f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:06.321319 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bcc4c12f-15dd-499e-b22e-07d62d42b87f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:06.322086 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bcc4c12f-15dd-499e-b22e-07d62d42b87f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:06.322526 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-bcc4c12f-15dd-499e-b22e-07d62d42b87f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:06.448516 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-bcc4c12f-15dd-499e-b22e-07d62d42b87f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:32:06.456835 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-bcc4c12f-15dd-499e-b22e-07d62d42b87f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1676 microversion: 2.1 time: 0.147971 Jul 31 14:32:06.457401 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 456/936] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:32:06 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:32:07.478214 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e55a17e3-9839-4493-85f9-8978bc4af747 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:32:07.478783 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e55a17e3-9839-4493-85f9-8978bc4af747 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:32:07.485223 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e55a17e3-9839-4493-85f9-8978bc4af747 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:07.485670 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e55a17e3-9839-4493-85f9-8978bc4af747 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:07.486926 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e55a17e3-9839-4493-85f9-8978bc4af747 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:07.487377 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e55a17e3-9839-4493-85f9-8978bc4af747 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:07.612785 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e55a17e3-9839-4493-85f9-8978bc4af747 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:32:07.621842 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e55a17e3-9839-4493-85f9-8978bc4af747 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1676 microversion: 2.1 time: 0.147530 Jul 31 14:32:07.622413 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 481/937] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:32:07 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:32:08.645234 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-661a61cf-be01-42a5-a374-b655545619f7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:32:08.645844 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-661a61cf-be01-42a5-a374-b655545619f7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:32:08.652307 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-661a61cf-be01-42a5-a374-b655545619f7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:08.652757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-661a61cf-be01-42a5-a374-b655545619f7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:08.653511 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-661a61cf-be01-42a5-a374-b655545619f7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:08.653947 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-661a61cf-be01-42a5-a374-b655545619f7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:08.779783 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-661a61cf-be01-42a5-a374-b655545619f7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:32:08.787313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-661a61cf-be01-42a5-a374-b655545619f7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1676 microversion: 2.1 time: 0.146609 Jul 31 14:32:08.787917 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 457/938] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:32:08 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:32:09.808631 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0167b9a3-536a-4f4a-9c9a-125289bbd28b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:32:09.809231 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0167b9a3-536a-4f4a-9c9a-125289bbd28b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:32:09.816270 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0167b9a3-536a-4f4a-9c9a-125289bbd28b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:09.816708 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0167b9a3-536a-4f4a-9c9a-125289bbd28b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:09.817456 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0167b9a3-536a-4f4a-9c9a-125289bbd28b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:09.817884 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0167b9a3-536a-4f4a-9c9a-125289bbd28b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:09.948479 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0167b9a3-536a-4f4a-9c9a-125289bbd28b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:32:09.956188 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0167b9a3-536a-4f4a-9c9a-125289bbd28b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1676 microversion: 2.1 time: 0.151463 Jul 31 14:32:09.956762 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 482/939] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:32:09 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:32:10.980049 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-d29e9ff2-625c-411d-b988-6fb3ab2a149d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:32:10.980663 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-d29e9ff2-625c-411d-b988-6fb3ab2a149d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:32:10.988081 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d29e9ff2-625c-411d-b988-6fb3ab2a149d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:10.988529 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d29e9ff2-625c-411d-b988-6fb3ab2a149d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:10.989294 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d29e9ff2-625c-411d-b988-6fb3ab2a149d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:10.989732 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d29e9ff2-625c-411d-b988-6fb3ab2a149d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:11.119384 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-d29e9ff2-625c-411d-b988-6fb3ab2a149d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:32:11.127323 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-d29e9ff2-625c-411d-b988-6fb3ab2a149d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1676 microversion: 2.1 time: 0.152861 Jul 31 14:32:11.127927 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 458/940] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:32:10 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:32:12.148623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b7f1e7de-6d1b-4d59-ab06-f9a9f23db4dd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:32:12.149230 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b7f1e7de-6d1b-4d59-ab06-f9a9f23db4dd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:32:12.155666 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b7f1e7de-6d1b-4d59-ab06-f9a9f23db4dd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:12.156110 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b7f1e7de-6d1b-4d59-ab06-f9a9f23db4dd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:12.156881 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b7f1e7de-6d1b-4d59-ab06-f9a9f23db4dd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:12.157297 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b7f1e7de-6d1b-4d59-ab06-f9a9f23db4dd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:12.286240 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b7f1e7de-6d1b-4d59-ab06-f9a9f23db4dd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:32:12.293613 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b7f1e7de-6d1b-4d59-ab06-f9a9f23db4dd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1676 microversion: 2.1 time: 0.148866 Jul 31 14:32:12.294154 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 483/941] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:32:12 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:32:13.315858 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-dfff62fa-3e3c-4934-9633-341cc3c0514b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:32:13.316476 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-dfff62fa-3e3c-4934-9633-341cc3c0514b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:32:13.322826 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dfff62fa-3e3c-4934-9633-341cc3c0514b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:13.323280 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dfff62fa-3e3c-4934-9633-341cc3c0514b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:13.324081 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dfff62fa-3e3c-4934-9633-341cc3c0514b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:13.324521 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-dfff62fa-3e3c-4934-9633-341cc3c0514b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:13.452140 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-dfff62fa-3e3c-4934-9633-341cc3c0514b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:32:13.459639 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-dfff62fa-3e3c-4934-9633-341cc3c0514b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1676 microversion: 2.1 time: 0.148206 Jul 31 14:32:13.460209 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 459/942] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:32:13 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:32:14.481262 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9817ff08-823f-4621-9d18-ea8eb8039ea6 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:32:14.481878 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9817ff08-823f-4621-9d18-ea8eb8039ea6 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:32:14.488933 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9817ff08-823f-4621-9d18-ea8eb8039ea6 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:14.489384 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9817ff08-823f-4621-9d18-ea8eb8039ea6 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:14.490147 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9817ff08-823f-4621-9d18-ea8eb8039ea6 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:14.490584 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9817ff08-823f-4621-9d18-ea8eb8039ea6 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:14.620306 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9817ff08-823f-4621-9d18-ea8eb8039ea6 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:32:14.627680 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9817ff08-823f-4621-9d18-ea8eb8039ea6 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1676 microversion: 2.1 time: 0.150237 Jul 31 14:32:14.628248 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 484/943] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:32:14 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:32:15.649404 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-faf79081-e414-4e9a-9d85-1abee7235570 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:32:15.650010 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-faf79081-e414-4e9a-9d85-1abee7235570 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:32:15.656861 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-faf79081-e414-4e9a-9d85-1abee7235570 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:15.657307 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-faf79081-e414-4e9a-9d85-1abee7235570 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:15.658757 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-faf79081-e414-4e9a-9d85-1abee7235570 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:15.659215 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-faf79081-e414-4e9a-9d85-1abee7235570 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:15.787815 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-faf79081-e414-4e9a-9d85-1abee7235570 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:32:15.795283 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-faf79081-e414-4e9a-9d85-1abee7235570 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1653 microversion: 2.1 time: 0.149742 Jul 31 14:32:15.795882 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 460/944] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:32:15 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1653 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:32:15.815993 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1e5c11ca-dda5-4fef-914a-65a620a9f1f9 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:32:15.822451 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1e5c11ca-dda5-4fef-914a-65a620a9f1f9 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:15.822899 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1e5c11ca-dda5-4fef-914a-65a620a9f1f9 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:15.881916 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1e5c11ca-dda5-4fef-914a-65a620a9f1f9 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Going to try to start instance {{(pid=117780) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 31 14:32:15.924585 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1e5c11ca-dda5-4fef-914a-65a620a9f1f9 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "POST /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad/action" status: 202 len: 0 microversion: 2.1 time: 0.112125 Jul 31 14:32:15.925407 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 485/945] 10.222.0.40 () {60 vars in 1278 bytes} [Sun Jul 31 14:32:15 2022] POST /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:32:15.933720 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-3559bd5b-db51-4ad5-aeeb-faaeb103a174 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:32:15.934323 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-3559bd5b-db51-4ad5-aeeb-faaeb103a174 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:32:15.940349 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3559bd5b-db51-4ad5-aeeb-faaeb103a174 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:15.940786 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3559bd5b-db51-4ad5-aeeb-faaeb103a174 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:15.941550 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3559bd5b-db51-4ad5-aeeb-faaeb103a174 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:15.941980 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3559bd5b-db51-4ad5-aeeb-faaeb103a174 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:16.079671 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-3559bd5b-db51-4ad5-aeeb-faaeb103a174 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:32:16.087780 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-3559bd5b-db51-4ad5-aeeb-faaeb103a174 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1662 microversion: 2.1 time: 0.157779 Jul 31 14:32:16.088346 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 461/946] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:32:15 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:32:17.110793 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-12049ce6-571d-4764-89b1-fe6506c67351 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:32:17.112671 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-12049ce6-571d-4764-89b1-fe6506c67351 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:32:17.119729 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-12049ce6-571d-4764-89b1-fe6506c67351 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:17.120184 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-12049ce6-571d-4764-89b1-fe6506c67351 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:17.120953 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-12049ce6-571d-4764-89b1-fe6506c67351 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:17.121391 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-12049ce6-571d-4764-89b1-fe6506c67351 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:17.250041 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-12049ce6-571d-4764-89b1-fe6506c67351 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:32:17.257374 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-12049ce6-571d-4764-89b1-fe6506c67351 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1666 microversion: 2.1 time: 0.151835 Jul 31 14:32:17.257946 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 486/947] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:32:17 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1666 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:32:49.416371 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-8b019866-9212-4741-a2d9-f0c178253160 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:32:49.418553 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-8b019866-9212-4741-a2d9-f0c178253160 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:32:49.420897 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=14 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:32:49.421545 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:32:49.428061 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8b019866-9212-4741-a2d9-f0c178253160 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:49.428512 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8b019866-9212-4741-a2d9-f0c178253160 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:49.429271 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8b019866-9212-4741-a2d9-f0c178253160 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:49.429707 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8b019866-9212-4741-a2d9-f0c178253160 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:49.460337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-8b019866-9212-4741-a2d9-f0c178253160 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047932 Jul 31 14:32:49.460924 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 462/948] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Jul 31 14:32:49 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 14:32:49.521480 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8bd8ef0d-603b-413b-ab46-c0ecc503535c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:32:49.522014 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8bd8ef0d-603b-413b-ab46-c0ecc503535c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:32:49.524238 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=16 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:32:49.524878 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:32:49.530335 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8bd8ef0d-603b-413b-ab46-c0ecc503535c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:49.530778 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8bd8ef0d-603b-413b-ab46-c0ecc503535c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:49.531573 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8bd8ef0d-603b-413b-ab46-c0ecc503535c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:49.532006 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8bd8ef0d-603b-413b-ab46-c0ecc503535c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:49.557548 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8bd8ef0d-603b-413b-ab46-c0ecc503535c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Going to try to terminate instance {{(pid=117780) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 14:32:49.628851 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8bd8ef0d-603b-413b-ab46-c0ecc503535c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "DELETE /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 204 len: 0 microversion: 2.1 time: 0.111370 Jul 31 14:32:49.629439 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 487/949] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:32:49 2022] DELETE /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 31 14:32:49.637774 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-3b12afe0-665d-4b4b-85f7-523afd7820d1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:32:49.638414 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-3b12afe0-665d-4b4b-85f7-523afd7820d1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:32:49.644873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3b12afe0-665d-4b4b-85f7-523afd7820d1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:49.645321 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3b12afe0-665d-4b4b-85f7-523afd7820d1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:49.646131 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3b12afe0-665d-4b4b-85f7-523afd7820d1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:49.646523 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3b12afe0-665d-4b4b-85f7-523afd7820d1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:49.829550 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-3b12afe0-665d-4b4b-85f7-523afd7820d1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:32:49.837679 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-3b12afe0-665d-4b4b-85f7-523afd7820d1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1672 microversion: 2.1 time: 0.204024 Jul 31 14:32:49.838249 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 463/950] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:32:49 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1672 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:32:50.859642 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-5a2c9a1a-cb1c-4b80-bd26-acba20591c4f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:32:50.860337 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-5a2c9a1a-cb1c-4b80-bd26-acba20591c4f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:32:50.867256 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5a2c9a1a-cb1c-4b80-bd26-acba20591c4f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:50.867747 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5a2c9a1a-cb1c-4b80-bd26-acba20591c4f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:50.868534 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5a2c9a1a-cb1c-4b80-bd26-acba20591c4f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:50.868973 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-5a2c9a1a-cb1c-4b80-bd26-acba20591c4f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:51.044859 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-5a2c9a1a-cb1c-4b80-bd26-acba20591c4f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:32:51.052875 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-5a2c9a1a-cb1c-4b80-bd26-acba20591c4f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1672 microversion: 2.1 time: 0.197548 Jul 31 14:32:51.053482 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 488/951] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:32:50 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1672 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:32:52.080508 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-8d01eec8-ebef-4422-a87c-d307c960dd8b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:32:52.081172 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-8d01eec8-ebef-4422-a87c-d307c960dd8b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:32:52.087864 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8d01eec8-ebef-4422-a87c-d307c960dd8b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:52.088312 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8d01eec8-ebef-4422-a87c-d307c960dd8b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:52.089084 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8d01eec8-ebef-4422-a87c-d307c960dd8b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:52.089523 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8d01eec8-ebef-4422-a87c-d307c960dd8b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:52.586883 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-8d01eec8-ebef-4422-a87c-d307c960dd8b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:32:52.594575 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-8d01eec8-ebef-4422-a87c-d307c960dd8b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 200 len: 1672 microversion: 2.1 time: 0.522797 Jul 31 14:32:52.595153 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 464/952] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:32:52 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 1672 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:32:52.859549 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-c39bd823-08a4-4e4a-ba1d-41b2590e80e6 req-995376e1-ea7f-49fd-b39a-915354cb7932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942db3cc-e948-4ef3-9dd1-381f74a0bbad", "name": "network-vif-deleted", "tag": "ee3d38d3-7bf3-4165-afbd-947c828cab7f"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:32:52.870203 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-c39bd823-08a4-4e4a-ba1d-41b2590e80e6 req-995376e1-ea7f-49fd-b39a-915354cb7932 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:52.870814 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-c39bd823-08a4-4e4a-ba1d-41b2590e80e6 req-995376e1-ea7f-49fd-b39a-915354cb7932 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:52.885833 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-c39bd823-08a4-4e4a-ba1d-41b2590e80e6 req-995376e1-ea7f-49fd-b39a-915354cb7932 service nova] Creating event network-vif-deleted:ee3d38d3-7bf3-4165-afbd-947c828cab7f for instance 942db3cc-e948-4ef3-9dd1-381f74a0bbad on hv-cinder-84984 Jul 31 14:32:52.895071 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-c39bd823-08a4-4e4a-ba1d-41b2590e80e6 req-995376e1-ea7f-49fd-b39a-915354cb7932 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039066 Jul 31 14:32:52.899171 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 489/953] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:32:53.616589 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-2ca5007d-96a4-474e-bff5-71dbca561fa4 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:32:53.617205 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-2ca5007d-96a4-474e-bff5-71dbca561fa4 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:32:53.624529 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2ca5007d-96a4-474e-bff5-71dbca561fa4 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:53.625179 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2ca5007d-96a4-474e-bff5-71dbca561fa4 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:53.625959 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2ca5007d-96a4-474e-bff5-71dbca561fa4 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:53.626403 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2ca5007d-96a4-474e-bff5-71dbca561fa4 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:53.641633 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.wsgi [None req-2ca5007d-96a4-474e-bff5-71dbca561fa4 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] HTTP exception thrown: Instance 942db3cc-e948-4ef3-9dd1-381f74a0bbad could not be found. Jul 31 14:32:53.643626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-2ca5007d-96a4-474e-bff5-71dbca561fa4 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Request method failure captured: Jul 31 14:32:53.643626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: request: GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad HTTP/1.1 Jul 31 14:32:53.643626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept: application/json Jul 31 14:32:53.643626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept-Encoding: identity Jul 31 14:32:53.643626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Connection: close Jul 31 14:32:53.643626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Length: 0 Jul 31 14:32:53.643626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Type: application/json Jul 31 14:32:53.643626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Host: 10.222.0.40 Jul 31 14:32:53.643626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Openstack-System-Scope: None Jul 31 14:32:53.643626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: User-Agent: python-urllib3/1.26.10 Jul 31 14:32:53.643626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Auth-Token: gAAAAABi5pHuOWCyOotqNPNhz6dH05EdJdRYcX3dTCZq4K6trbt6bcr_x2T83Niq8MfUZqVwzUOYnNC8mwfhj8pMnnueA45ZutnJsOvtv6Hr5AuZbYwFx4jRzmyjvO3QdnRT2XQqlWqIM7wolafKeKxZdtpE9m6jhChVIxOZ1g__cgRvnV5wR7w Jul 31 14:32:53.643626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Id: None Jul 31 14:32:53.643626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Name: None Jul 31 14:32:53.643626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Identity-Status: Confirmed Jul 31 14:32:53.643626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Is-Admin-Project: True Jul 31 14:32:53.643626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Id: default Jul 31 14:32:53.643626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Name: Default Jul 31 14:32:53.643626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Id: 1eec425dcc93489d9db53600cb95458d Jul 31 14:32:53.643626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Name: tempest-AttachVolumeTestJSON-821291449 Jul 31 14:32:53.643626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Role: reader,member Jul 31 14:32:53.643626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Roles: reader,member Jul 31 14:32:53.645273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1eec425dcc93489d9db53600cb95458d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1eec425dcc93489d9db53600cb95458d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1eec425dcc93489d9db53600cb95458d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1eec425dcc93489d9db53600cb95458d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:32:53.645273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant: tempest-AttachVolumeTestJSON-821291449 Jul 31 14:32:53.645273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Id: 1eec425dcc93489d9db53600cb95458d Jul 31 14:32:53.645273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Name: tempest-AttachVolumeTestJSON-821291449 Jul 31 14:32:53.645273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User: tempest-AttachVolumeTestJSON-821291449-project Jul 31 14:32:53.645273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Id: default Jul 31 14:32:53.645273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Name: Default Jul 31 14:32:53.645273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Id: 1d69118a87374b14b0f85a23979d5264 Jul 31 14:32:53.645273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Name: tempest-AttachVolumeTestJSON-821291449-project Jul 31 14:32:53.645273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: method: > Jul 31 14:32:53.645273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: exception: Instance 942db3cc-e948-4ef3-9dd1-381f74a0bbad could not be found. Jul 31 14:32:53.645273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: action_args: {'id': '942db3cc-e948-4ef3-9dd1-381f74a0bbad'} Jul 31 14:32:53.649667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:32:53.649667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:32:53.649667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:32:53.649667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:32:53.649667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:32:53.649667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:32:53.649667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:32:53.649667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:32:53.649667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:32:53.649667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:32:53.649667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 942db3cc-e948-4ef3-9dd1-381f74a0bbad could not be found. Jul 31 14:32:53.649667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:32:53.649667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:32:53.649667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:32:53.649667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:32:53.649667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:32:53.649667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:32:53.649667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:32:53.649667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:32:53.649667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:32:53.651313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:32:53.651313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:32:53.651313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:32:53.651313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:32:53.651313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:32:53.651313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:32:53.651313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:32:53.651313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 942db3cc-e948-4ef3-9dd1-381f74a0bbad could not be found. Jul 31 14:32:53.651313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:32:53.651313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:32:53.651313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:32:53.651313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:32:53.651313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:32:53.651313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:32:53.651313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:32:53.651313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:32:53.651313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 942db3cc-e948-4ef3-9dd1-381f74a0bbad could not be found. Jul 31 14:32:53.651313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:32:53.652789 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-2ca5007d-96a4-474e-bff5-71dbca561fa4 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Returning 404 to user: Instance 942db3cc-e948-4ef3-9dd1-381f74a0bbad could not be found. {{(pid=117781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:32:53.652789 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-2ca5007d-96a4-474e-bff5-71dbca561fa4 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 404 len: 111 microversion: 2.1 time: 0.032368 Jul 31 14:32:53.652789 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 465/954] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:32:53 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:32:53.656735 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-41b573db-fa32-43a0-9494-28d135ad2fd8 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '.version_select at 0x7f87e9975160>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:32:53.677719 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-41b573db-fa32-43a0-9494-28d135ad2fd8 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-148188395" status: 202 len: 0 microversion: 2.1 time: 0.026495 Jul 31 14:32:53.677719 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 490/955] 10.222.0.40 () {58 vars in 1218 bytes} [Sun Jul 31 14:32:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-148188395 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:32:54.316457 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-2713fc11-8ebc-46a3-890e-3260506c673f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Action: 'create', calling method: .version_select at 0x7f87e98990d0>, body: {"keypair": {"name": "tempest-keypair-2030136901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAU9bO31adC9E9FfEqXGFN+qV+x3TJEMxPJvrmdlSuzHHBsnHJVMkoKZLhs/zN4/JBEBRm2nyoM9Cjjn8WisUpy3PaCgTJtMCTku51OhCN2/vPW+v+rkmqU52PbMnuS/4g=="}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:32:54.332267 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-2713fc11-8ebc-46a3-890e-3260506c673f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Getting quotas for project 1eec425dcc93489d9db53600cb95458d. Resources: {'key_pairs'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:32:54.336054 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-2713fc11-8ebc-46a3-890e-3260506c673f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Getting quotas for user 1d69118a87374b14b0f85a23979d5264 and project 1eec425dcc93489d9db53600cb95458d. Resources: {'key_pairs'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:32:54.347685 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2713fc11-8ebc-46a3-890e-3260506c673f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [d15dfaf1-2a95-46b0-ba7f-48de537b28a9] AMQP server on 10.222.0.40:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 31 14:32:55.355822 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO oslo.messaging._drivers.impl_rabbit [None req-2713fc11-8ebc-46a3-890e-3260506c673f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [d15dfaf1-2a95-46b0-ba7f-48de537b28a9] Reconnected to AMQP server on 10.222.0.40:5672 via [amqp] client with port 58514. Jul 31 14:32:55.372118 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-2713fc11-8ebc-46a3-890e-3260506c673f tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.060021 Jul 31 14:32:55.372718 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 466/956] 10.222.0.40 () {60 vars in 1159 bytes} [Sun Jul 31 14:32:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:32:56.866324 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8d7a00d9-bba0-4c39-b0b9-5ef713b1ed4d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1663843945", "imageRef": "57bc051a-64d0-4317-aa93-a7a2aed39369", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8c278ad5-3c57-484f-8e61-b722cfb0d058"}], "security_groups": [{"name": "tempest-securitygroup--1822424148"}], "key_name": "tempest-keypair-2030136901", "user_data": "}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:32:56.968007 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.network.neutron [None req-8d7a00d9-bba0-4c39-b0b9-5ef713b1ed4d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] validate_networks() for [('8c278ad5-3c57-484f-8e61-b722cfb0d058', None, None, None, None, None)] {{(pid=117780) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 14:32:57.377586 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-8d7a00d9-bba0-4c39-b0b9-5ef713b1ed4d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Flavor limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 14:32:57.378008 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-8d7a00d9-bba0-4c39-b0b9-5ef713b1ed4d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Image limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 14:32:57.378476 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-8d7a00d9-bba0-4c39-b0b9-5ef713b1ed4d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Flavor pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 14:32:57.378882 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-8d7a00d9-bba0-4c39-b0b9-5ef713b1ed4d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Image pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 14:32:57.379291 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-8d7a00d9-bba0-4c39-b0b9-5ef713b1ed4d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 14:32:57.388014 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8d7a00d9-bba0-4c39-b0b9-5ef713b1ed4d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:57.388402 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8d7a00d9-bba0-4c39-b0b9-5ef713b1ed4d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:57.389195 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8d7a00d9-bba0-4c39-b0b9-5ef713b1ed4d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:57.389627 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8d7a00d9-bba0-4c39-b0b9-5ef713b1ed4d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:57.405704 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-8d7a00d9-bba0-4c39-b0b9-5ef713b1ed4d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Getting quotas for project 1eec425dcc93489d9db53600cb95458d. Resources: {'cores', 'ram', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:32:57.410033 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-8d7a00d9-bba0-4c39-b0b9-5ef713b1ed4d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Getting quotas for user 1d69118a87374b14b0f85a23979d5264 and project 1eec425dcc93489d9db53600cb95458d. Resources: {'cores', 'ram', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:32:57.420683 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8d7a00d9-bba0-4c39-b0b9-5ef713b1ed4d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Going to run 1 instances... {{(pid=117780) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 14:32:57.422983 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8d7a00d9-bba0-4c39-b0b9-5ef713b1ed4d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57bc051a-64d0-4317-aa93-a7a2aed39369',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 14:32:57.468050 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8d7a00d9-bba0-4c39-b0b9-5ef713b1ed4d tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.607107 Jul 31 14:32:57.468693 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 491/957] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Jul 31 14:32:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 14:32:57.480669 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-e4dca668-46e5-4296-9369-2d86fa387299 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:32:57.481284 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-e4dca668-46e5-4296-9369-2d86fa387299 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:32:57.535114 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e4dca668-46e5-4296-9369-2d86fa387299 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:32:57.541878 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-e4dca668-46e5-4296-9369-2d86fa387299 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd" status: 200 len: 1238 microversion: 2.1 time: 0.065561 Jul 31 14:32:57.542539 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 467/958] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:32:57 2022] GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:32:58.564008 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-020d87cc-3f39-45e8-95ec-cecc5394c139 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:32:58.565389 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-020d87cc-3f39-45e8-95ec-cecc5394c139 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:32:58.572170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-020d87cc-3f39-45e8-95ec-cecc5394c139 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:58.572728 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-020d87cc-3f39-45e8-95ec-cecc5394c139 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:58.573491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-020d87cc-3f39-45e8-95ec-cecc5394c139 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:58.573928 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-020d87cc-3f39-45e8-95ec-cecc5394c139 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:58.648547 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-020d87cc-3f39-45e8-95ec-cecc5394c139 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:32:58.655888 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-020d87cc-3f39-45e8-95ec-cecc5394c139 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd" status: 200 len: 1296 microversion: 2.1 time: 0.096357 Jul 31 14:32:58.656454 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 492/959] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:32:58 2022] GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd => generated 1296 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:32:59.677023 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-37b194e2-0e11-4da7-a173-dce6f65581b4 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:32:59.677738 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-37b194e2-0e11-4da7-a173-dce6f65581b4 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:32:59.684402 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-37b194e2-0e11-4da7-a173-dce6f65581b4 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:59.684853 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-37b194e2-0e11-4da7-a173-dce6f65581b4 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:59.685623 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-37b194e2-0e11-4da7-a173-dce6f65581b4 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:59.686069 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-37b194e2-0e11-4da7-a173-dce6f65581b4 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:59.725109 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-ed77948d-1569-4f2e-bf70-b49afc43907e req-f3333954-e5bd-49bd-96f5-16ab766353db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f36be164-718f-4738-bb6c-6a5618f80fdd", "tag": "1a0c7b25-db13-439d-92e3-5da8e6c0ab55"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:32:59.736936 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-ed77948d-1569-4f2e-bf70-b49afc43907e req-f3333954-e5bd-49bd-96f5-16ab766353db service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:32:59.737563 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-ed77948d-1569-4f2e-bf70-b49afc43907e req-f3333954-e5bd-49bd-96f5-16ab766353db service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:32:59.748462 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-ed77948d-1569-4f2e-bf70-b49afc43907e req-f3333954-e5bd-49bd-96f5-16ab766353db service nova] Creating event network-changed:1a0c7b25-db13-439d-92e3-5da8e6c0ab55 for instance f36be164-718f-4738-bb6c-6a5618f80fdd on hv-cinder-84984 Jul 31 14:32:59.754841 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-ed77948d-1569-4f2e-bf70-b49afc43907e req-f3333954-e5bd-49bd-96f5-16ab766353db service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034212 Jul 31 14:32:59.755365 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 493/960] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:32:59.922470 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-37b194e2-0e11-4da7-a173-dce6f65581b4 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:32:59.930679 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-37b194e2-0e11-4da7-a173-dce6f65581b4 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd" status: 200 len: 1364 microversion: 2.1 time: 0.257691 Jul 31 14:32:59.931258 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 468/961] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:32:59 2022] GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd => generated 1364 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:33:00.952920 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a7074302-5375-4aab-80d2-d3806f58963a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:00.953610 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a7074302-5375-4aab-80d2-d3806f58963a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:00.961630 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a7074302-5375-4aab-80d2-d3806f58963a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:00.962080 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a7074302-5375-4aab-80d2-d3806f58963a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:00.962846 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a7074302-5375-4aab-80d2-d3806f58963a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:00.963350 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a7074302-5375-4aab-80d2-d3806f58963a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:01.097831 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a7074302-5375-4aab-80d2-d3806f58963a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:33:01.105397 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a7074302-5375-4aab-80d2-d3806f58963a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd" status: 200 len: 1364 microversion: 2.1 time: 0.156952 Jul 31 14:33:01.105970 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 494/962] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:33:00 2022] GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:33:02.126262 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-3bc6e0b0-ba82-4e63-a598-777a98c8151a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:02.126869 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-3bc6e0b0-ba82-4e63-a598-777a98c8151a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:02.133369 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3bc6e0b0-ba82-4e63-a598-777a98c8151a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:02.133821 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3bc6e0b0-ba82-4e63-a598-777a98c8151a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:02.134576 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3bc6e0b0-ba82-4e63-a598-777a98c8151a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:02.135014 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3bc6e0b0-ba82-4e63-a598-777a98c8151a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:02.264953 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-3bc6e0b0-ba82-4e63-a598-777a98c8151a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:33:02.272870 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-3bc6e0b0-ba82-4e63-a598-777a98c8151a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd" status: 200 len: 1364 microversion: 2.1 time: 0.150568 Jul 31 14:33:02.273443 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 469/963] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:33:02 2022] GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:33:03.294360 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-7cb57a1d-ec26-4b32-94da-6da895f8b64c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:03.294904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-7cb57a1d-ec26-4b32-94da-6da895f8b64c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:03.302026 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7cb57a1d-ec26-4b32-94da-6da895f8b64c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:03.302477 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7cb57a1d-ec26-4b32-94da-6da895f8b64c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:03.303237 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7cb57a1d-ec26-4b32-94da-6da895f8b64c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:03.303696 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-7cb57a1d-ec26-4b32-94da-6da895f8b64c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:03.429933 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-7cb57a1d-ec26-4b32-94da-6da895f8b64c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:33:03.437455 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-7cb57a1d-ec26-4b32-94da-6da895f8b64c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd" status: 200 len: 1364 microversion: 2.1 time: 0.147030 Jul 31 14:33:03.438023 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 495/964] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:33:03 2022] GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:33:04.459574 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-2e85fa9a-4c53-4ae2-974a-fd2ad70d6af7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:04.460190 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-2e85fa9a-4c53-4ae2-974a-fd2ad70d6af7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:04.466793 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2e85fa9a-4c53-4ae2-974a-fd2ad70d6af7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:04.467241 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2e85fa9a-4c53-4ae2-974a-fd2ad70d6af7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:04.468037 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2e85fa9a-4c53-4ae2-974a-fd2ad70d6af7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:04.468474 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2e85fa9a-4c53-4ae2-974a-fd2ad70d6af7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:04.594094 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-2e85fa9a-4c53-4ae2-974a-fd2ad70d6af7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:33:04.602199 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-2e85fa9a-4c53-4ae2-974a-fd2ad70d6af7 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd" status: 200 len: 1364 microversion: 2.1 time: 0.147120 Jul 31 14:33:04.602776 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 470/965] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:33:04 2022] GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:33:04.886952 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-4f04a037-f219-4763-bf74-a77ff2984005 req-09e741a2-ae22-4e1e-bf32-ea60502b26aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36be164-718f-4738-bb6c-6a5618f80fdd", "name": "network-vif-plugged", "status": "completed", "tag": "1a0c7b25-db13-439d-92e3-5da8e6c0ab55"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:33:04.897917 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-4f04a037-f219-4763-bf74-a77ff2984005 req-09e741a2-ae22-4e1e-bf32-ea60502b26aa service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:04.898519 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-4f04a037-f219-4763-bf74-a77ff2984005 req-09e741a2-ae22-4e1e-bf32-ea60502b26aa service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:04.910725 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-4f04a037-f219-4763-bf74-a77ff2984005 req-09e741a2-ae22-4e1e-bf32-ea60502b26aa service nova] Creating event network-vif-plugged:1a0c7b25-db13-439d-92e3-5da8e6c0ab55 for instance f36be164-718f-4738-bb6c-6a5618f80fdd on hv-cinder-84984 Jul 31 14:33:04.915688 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-4f04a037-f219-4763-bf74-a77ff2984005 req-09e741a2-ae22-4e1e-bf32-ea60502b26aa service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032353 Jul 31 14:33:04.916282 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 496/966] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:33:05.623066 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-581b1136-6048-4944-a18c-9c6833977065 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:05.623710 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-581b1136-6048-4944-a18c-9c6833977065 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:05.630347 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-581b1136-6048-4944-a18c-9c6833977065 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:05.630799 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-581b1136-6048-4944-a18c-9c6833977065 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:05.631606 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-581b1136-6048-4944-a18c-9c6833977065 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:05.632047 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-581b1136-6048-4944-a18c-9c6833977065 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:05.768569 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-581b1136-6048-4944-a18c-9c6833977065 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:33:05.776011 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-581b1136-6048-4944-a18c-9c6833977065 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd" status: 200 len: 1364 microversion: 2.1 time: 0.156937 Jul 31 14:33:05.776575 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 471/967] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:33:05 2022] GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:33:06.797349 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-35861018-338e-4211-8e4f-2fa76c3d0d65 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:06.798039 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-35861018-338e-4211-8e4f-2fa76c3d0d65 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:06.804924 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-35861018-338e-4211-8e4f-2fa76c3d0d65 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:06.805372 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-35861018-338e-4211-8e4f-2fa76c3d0d65 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:06.806130 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-35861018-338e-4211-8e4f-2fa76c3d0d65 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:06.806565 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-35861018-338e-4211-8e4f-2fa76c3d0d65 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:06.942220 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-35861018-338e-4211-8e4f-2fa76c3d0d65 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:33:06.949600 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-35861018-338e-4211-8e4f-2fa76c3d0d65 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd" status: 200 len: 1549 microversion: 2.1 time: 0.156501 Jul 31 14:33:06.950416 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 497/968] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:33:06 2022] GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:33:06.972844 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-34bb134b-45e9-4a70-8991-942aab9404da tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:06.973514 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-34bb134b-45e9-4a70-8991-942aab9404da tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:06.980463 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-34bb134b-45e9-4a70-8991-942aab9404da tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:06.980919 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-34bb134b-45e9-4a70-8991-942aab9404da tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:06.981725 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-34bb134b-45e9-4a70-8991-942aab9404da tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:06.982162 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-34bb134b-45e9-4a70-8991-942aab9404da tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:07.057650 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-34bb134b-45e9-4a70-8991-942aab9404da tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089324 Jul 31 14:33:07.058246 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 472/969] 10.222.0.40 () {58 vars in 1275 bytes} [Sun Jul 31 14:33:06 2022] GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:33:08.246016 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-a181f95b-c2d8-4c45-bfea-86673953a3be req-e51aa7b4-f056-4edc-9a11-f07911c56a8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f36be164-718f-4738-bb6c-6a5618f80fdd", "tag": "1a0c7b25-db13-439d-92e3-5da8e6c0ab55"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:33:08.250769 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:33:08.251446 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=6 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:33:08.258908 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-a181f95b-c2d8-4c45-bfea-86673953a3be req-e51aa7b4-f056-4edc-9a11-f07911c56a8c service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:08.259356 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-a181f95b-c2d8-4c45-bfea-86673953a3be req-e51aa7b4-f056-4edc-9a11-f07911c56a8c service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:08.271207 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-a181f95b-c2d8-4c45-bfea-86673953a3be req-e51aa7b4-f056-4edc-9a11-f07911c56a8c service nova] Creating event network-changed:1a0c7b25-db13-439d-92e3-5da8e6c0ab55 for instance f36be164-718f-4738-bb6c-6a5618f80fdd on hv-cinder-84984 Jul 31 14:33:08.278488 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-a181f95b-c2d8-4c45-bfea-86673953a3be req-e51aa7b4-f056-4edc-9a11-f07911c56a8c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035802 Jul 31 14:33:08.279375 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 498/970] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:33:44.328336 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=6 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:33:44.329835 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:33:44.330452 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=48 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:33:44.335171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-5b937473-b2cb-43e5-991b-1e496b54b2be tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:44.335630 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-5b937473-b2cb-43e5-991b-1e496b54b2be tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:44.342815 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5b937473-b2cb-43e5-991b-1e496b54b2be tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:44.343252 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5b937473-b2cb-43e5-991b-1e496b54b2be tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:44.344021 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5b937473-b2cb-43e5-991b-1e496b54b2be tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:44.344451 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-5b937473-b2cb-43e5-991b-1e496b54b2be tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:44.367662 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-5b937473-b2cb-43e5-991b-1e496b54b2be tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/ips" status: 200 len: 145 microversion: 2.1 time: 0.040015 Jul 31 14:33:44.368216 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 473/971] 10.222.0.40 () {58 vars in 1248 bytes} [Sun Jul 31 14:33:44 2022] GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:33:45.586127 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:33:45.586886 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:33:45.591299 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-69f2d813-8394-4bfd-8ac8-0104fd841e82 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:45.591905 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-69f2d813-8394-4bfd-8ac8-0104fd841e82 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:45.601261 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-69f2d813-8394-4bfd-8ac8-0104fd841e82 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:45.601707 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-69f2d813-8394-4bfd-8ac8-0104fd841e82 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:45.602466 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-69f2d813-8394-4bfd-8ac8-0104fd841e82 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:45.602902 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-69f2d813-8394-4bfd-8ac8-0104fd841e82 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:45.629750 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-69f2d813-8394-4bfd-8ac8-0104fd841e82 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] Going to try to terminate instance {{(pid=117780) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 14:33:45.699967 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-2a0fabe9-7884-451b-81f8-d780c3103059 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c2fbf4b-b25c-4b26-9a4b-a192953ad75e"}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:33:45.703002 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-2a0fabe9-7884-451b-81f8-d780c3103059 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:45.711341 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2a0fabe9-7884-451b-81f8-d780c3103059 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:45.711649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-69f2d813-8394-4bfd-8ac8-0104fd841e82 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "DELETE /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc" status: 204 len: 0 microversion: 2.1 time: 0.126835 Jul 31 14:33:45.712212 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2a0fabe9-7884-451b-81f8-d780c3103059 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:45.712368 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 499/972] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:33:45 2022] DELETE /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 14:33:45.712917 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2a0fabe9-7884-451b-81f8-d780c3103059 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:45.713359 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2a0fabe9-7884-451b-81f8-d780c3103059 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:45.722663 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-73c73e17-1741-47d3-88db-ee62f3bbd365 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:45.723362 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-73c73e17-1741-47d3-88db-ee62f3bbd365 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:45.729277 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-73c73e17-1741-47d3-88db-ee62f3bbd365 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:45.729739 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-73c73e17-1741-47d3-88db-ee62f3bbd365 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:45.730505 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-73c73e17-1741-47d3-88db-ee62f3bbd365 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:45.730945 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-73c73e17-1741-47d3-88db-ee62f3bbd365 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:45.863210 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-73c73e17-1741-47d3-88db-ee62f3bbd365 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:33:45.870938 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-73c73e17-1741-47d3-88db-ee62f3bbd365 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc" status: 200 len: 1578 microversion: 2.1 time: 0.153095 Jul 31 14:33:45.871700 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 500/973] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:33:45 2022] GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:33:46.892764 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c470eabe-3691-4529-b926-113674095c53 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:46.893390 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c470eabe-3691-4529-b926-113674095c53 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:46.900903 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c470eabe-3691-4529-b926-113674095c53 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:46.901356 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c470eabe-3691-4529-b926-113674095c53 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:46.902265 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c470eabe-3691-4529-b926-113674095c53 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:46.902657 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c470eabe-3691-4529-b926-113674095c53 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:46.959605 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-2a0fabe9-7884-451b-81f8-d780c3103059 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "POST /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.264026 Jul 31 14:33:46.960695 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 474/974] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Jul 31 14:33:45 2022] POST /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-volume_attachments => generated 194 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:33:47.045939 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c470eabe-3691-4529-b926-113674095c53 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:33:47.055310 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c470eabe-3691-4529-b926-113674095c53 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc" status: 200 len: 1578 microversion: 2.1 time: 0.166504 Jul 31 14:33:47.056070 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 501/975] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:33:46 2022] GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:33:48.078276 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-a55412cc-26d5-4c80-b2c8-c97e62bfa663 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:48.078983 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-a55412cc-26d5-4c80-b2c8-c97e62bfa663 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:48.086205 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a55412cc-26d5-4c80-b2c8-c97e62bfa663 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:48.087044 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a55412cc-26d5-4c80-b2c8-c97e62bfa663 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:48.088376 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a55412cc-26d5-4c80-b2c8-c97e62bfa663 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:48.088982 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a55412cc-26d5-4c80-b2c8-c97e62bfa663 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:48.161258 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a55412cc-26d5-4c80-b2c8-c97e62bfa663 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:33:48.168935 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-a55412cc-26d5-4c80-b2c8-c97e62bfa663 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc" status: 200 len: 1510 microversion: 2.1 time: 0.095719 Jul 31 14:33:48.177751 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 475/976] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:33:48 2022] GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc => generated 1510 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:33:48.289158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-108e2ed6-78ca-414c-9bba-46ba12078940 req-74e8e72f-9de3-44ed-9188-f2042b848d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34675f3a-4930-453a-9c06-142fabaa0dcc", "name": "network-vif-deleted", "tag": "12d3e4ce-529c-4b75-a6d6-c27a4c8b2640"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:33:48.304519 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-108e2ed6-78ca-414c-9bba-46ba12078940 req-74e8e72f-9de3-44ed-9188-f2042b848d47 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:48.305151 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-108e2ed6-78ca-414c-9bba-46ba12078940 req-74e8e72f-9de3-44ed-9188-f2042b848d47 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:48.317360 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-108e2ed6-78ca-414c-9bba-46ba12078940 req-74e8e72f-9de3-44ed-9188-f2042b848d47 service nova] Creating event network-vif-deleted:12d3e4ce-529c-4b75-a6d6-c27a4c8b2640 for instance 34675f3a-4930-453a-9c06-142fabaa0dcc on hv-cinder-84984 Jul 31 14:33:48.322173 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-108e2ed6-78ca-414c-9bba-46ba12078940 req-74e8e72f-9de3-44ed-9188-f2042b848d47 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110053 Jul 31 14:33:48.322779 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 502/977] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:33:49.190087 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-9ff0cbd9-7671-42d4-8e45-40bd7ec376c0 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:49.191226 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-9ff0cbd9-7671-42d4-8e45-40bd7ec376c0 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:49.197773 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9ff0cbd9-7671-42d4-8e45-40bd7ec376c0 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:49.198229 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9ff0cbd9-7671-42d4-8e45-40bd7ec376c0 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:49.199000 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9ff0cbd9-7671-42d4-8e45-40bd7ec376c0 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:49.199463 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9ff0cbd9-7671-42d4-8e45-40bd7ec376c0 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:49.213528 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.wsgi [None req-9ff0cbd9-7671-42d4-8e45-40bd7ec376c0 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] HTTP exception thrown: Instance 34675f3a-4930-453a-9c06-142fabaa0dcc could not be found. Jul 31 14:33:49.215171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-9ff0cbd9-7671-42d4-8e45-40bd7ec376c0 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Request method failure captured: Jul 31 14:33:49.215171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: request: GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc HTTP/1.1 Jul 31 14:33:49.215171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept: application/json Jul 31 14:33:49.215171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept-Encoding: identity Jul 31 14:33:49.215171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Connection: close Jul 31 14:33:49.215171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Length: 0 Jul 31 14:33:49.215171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Type: application/json Jul 31 14:33:49.215171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Host: 10.222.0.40 Jul 31 14:33:49.215171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Openstack-System-Scope: None Jul 31 14:33:49.215171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: User-Agent: python-urllib3/1.26.10 Jul 31 14:33:49.215171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Auth-Token: gAAAAABi5pIuPU2jZpZf2xDz2TAPb6FX5LrwVhaqR1PsgzjEvsOJhbDC_23vsYwLOo5bPGFkfflN5J9J67K3925nUzp7RSIVvRlzDYhKPbFFP1Mx6Jv6M1Qjc1_prKYtBwjkdnNszLppFt1xa9wjzPs0Grz4Lk61dmK0vjI0Oo-6OCPiKvN_Lrk Jul 31 14:33:49.215171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Id: None Jul 31 14:33:49.215171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Name: None Jul 31 14:33:49.215171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Identity-Status: Confirmed Jul 31 14:33:49.215171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Is-Admin-Project: True Jul 31 14:33:49.215171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Id: default Jul 31 14:33:49.215171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Name: Default Jul 31 14:33:49.215171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Id: 8561e7f1f3d040e28d5084ebf937e198 Jul 31 14:33:49.215171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Name: tempest-TestVolumeBootPattern-777606254 Jul 31 14:33:49.215171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Role: reader,member Jul 31 14:33:49.215171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Roles: reader,member Jul 31 14:33:49.216937 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8561e7f1f3d040e28d5084ebf937e198"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8561e7f1f3d040e28d5084ebf937e198", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8561e7f1f3d040e28d5084ebf937e198"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8561e7f1f3d040e28d5084ebf937e198"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:33:49.216937 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant: tempest-TestVolumeBootPattern-777606254 Jul 31 14:33:49.216937 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Id: 8561e7f1f3d040e28d5084ebf937e198 Jul 31 14:33:49.216937 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Name: tempest-TestVolumeBootPattern-777606254 Jul 31 14:33:49.216937 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User: tempest-TestVolumeBootPattern-777606254-project Jul 31 14:33:49.216937 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Id: default Jul 31 14:33:49.216937 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Name: Default Jul 31 14:33:49.216937 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Id: 0bbe35ad557841c581e3b1a4aa272f38 Jul 31 14:33:49.216937 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Name: tempest-TestVolumeBootPattern-777606254-project Jul 31 14:33:49.216937 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: method: > Jul 31 14:33:49.216937 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: exception: Instance 34675f3a-4930-453a-9c06-142fabaa0dcc could not be found. Jul 31 14:33:49.216937 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: action_args: {'id': '34675f3a-4930-453a-9c06-142fabaa0dcc'} Jul 31 14:33:49.217778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:33:49.217778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:33:49.217778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:33:49.217778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:33:49.217778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:33:49.217778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:33:49.217778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:33:49.217778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:33:49.217778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:33:49.217778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:33:49.217778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34675f3a-4930-453a-9c06-142fabaa0dcc could not be found. Jul 31 14:33:49.217778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:33:49.217778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:33:49.217778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:33:49.217778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:33:49.217778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:33:49.217778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:33:49.217778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:33:49.217778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:33:49.217778 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:33:49.219104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:33:49.219104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:33:49.219104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:33:49.219104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:33:49.219104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:33:49.219104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:33:49.219104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:33:49.219104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34675f3a-4930-453a-9c06-142fabaa0dcc could not be found. Jul 31 14:33:49.219104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:33:49.219104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:33:49.219104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:33:49.219104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:33:49.219104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:33:49.219104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:33:49.219104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:33:49.219104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:33:49.219104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34675f3a-4930-453a-9c06-142fabaa0dcc could not be found. Jul 31 14:33:49.219104 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:33:49.220302 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-9ff0cbd9-7671-42d4-8e45-40bd7ec376c0 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Returning 404 to user: Instance 34675f3a-4930-453a-9c06-142fabaa0dcc could not be found. {{(pid=117781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:33:49.220302 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-9ff0cbd9-7671-42d4-8e45-40bd7ec376c0 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc" status: 404 len: 111 microversion: 2.1 time: 0.030440 Jul 31 14:33:49.220302 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 476/978] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:33:49 2022] GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:33:49.266392 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-41d6c672-bb3f-44f3-8b5b-d13d68a48f3b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1538153480", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1450971051", "security_groups": [{"name": "tempest-secgroup-smoke-1991941503"}], "block_device_mapping_v2": [{"uuid": "413bc850-a58d-4140-a40b-612c424e2b39", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4031262c-bbbd-4f7f-958b-e948963cb0b2"}]}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:33:49.385071 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.network.neutron [None req-41d6c672-bb3f-44f3-8b5b-d13d68a48f3b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] validate_networks() for [('4031262c-bbbd-4f7f-958b-e948963cb0b2', None, None, None, None, None)] {{(pid=117780) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 14:33:49.748009 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-41d6c672-bb3f-44f3-8b5b-d13d68a48f3b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Flavor limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 14:33:49.748458 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-41d6c672-bb3f-44f3-8b5b-d13d68a48f3b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Image limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 14:33:49.748927 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-41d6c672-bb3f-44f3-8b5b-d13d68a48f3b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Flavor pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 14:33:49.749332 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-41d6c672-bb3f-44f3-8b5b-d13d68a48f3b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Image pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 14:33:49.749740 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-41d6c672-bb3f-44f3-8b5b-d13d68a48f3b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 14:33:49.758537 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-41d6c672-bb3f-44f3-8b5b-d13d68a48f3b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:49.758921 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-41d6c672-bb3f-44f3-8b5b-d13d68a48f3b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:49.759749 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-41d6c672-bb3f-44f3-8b5b-d13d68a48f3b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:49.760185 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-41d6c672-bb3f-44f3-8b5b-d13d68a48f3b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:49.776378 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-41d6c672-bb3f-44f3-8b5b-d13d68a48f3b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Getting quotas for project 8561e7f1f3d040e28d5084ebf937e198. Resources: {'cores', 'ram', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:33:49.780332 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-41d6c672-bb3f-44f3-8b5b-d13d68a48f3b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Getting quotas for user 0bbe35ad557841c581e3b1a4aa272f38 and project 8561e7f1f3d040e28d5084ebf937e198. Resources: {'cores', 'ram', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:33:49.840677 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-41d6c672-bb3f-44f3-8b5b-d13d68a48f3b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Going to run 1 instances... {{(pid=117780) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 14:33:49.842883 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-41d6c672-bb3f-44f3-8b5b-d13d68a48f3b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: ea499741-0bd8-4766-b692-1894c085cfc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='413bc850-a58d-4140-a40b-612c424e2b39',volume_size=None,volume_type=None)] {{(pid=117780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 14:33:49.966564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-41d6c672-bb3f-44f3-8b5b-d13d68a48f3b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.705000 Jul 31 14:33:49.967216 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 503/979] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Jul 31 14:33:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 14:33:49.978712 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-926a945f-52f6-4d93-a524-4b129e66fc7d tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:49.979328 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-926a945f-52f6-4d93-a524-4b129e66fc7d tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: ea499741-0bd8-4766-b692-1894c085cfc9] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:50.033515 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-926a945f-52f6-4d93-a524-4b129e66fc7d tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:33:50.041462 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-926a945f-52f6-4d93-a524-4b129e66fc7d tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9" status: 200 len: 1095 microversion: 2.1 time: 0.066528 Jul 31 14:33:50.048628 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 477/980] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:33:49 2022] GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:33:51.062689 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-eb3dce5c-bc7f-41ba-8364-b0b081c82b78 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:51.063819 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-eb3dce5c-bc7f-41ba-8364-b0b081c82b78 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: ea499741-0bd8-4766-b692-1894c085cfc9] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:51.070480 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-eb3dce5c-bc7f-41ba-8364-b0b081c82b78 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:51.070937 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-eb3dce5c-bc7f-41ba-8364-b0b081c82b78 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:51.071767 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-eb3dce5c-bc7f-41ba-8364-b0b081c82b78 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:51.072208 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-eb3dce5c-bc7f-41ba-8364-b0b081c82b78 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:51.145401 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-eb3dce5c-bc7f-41ba-8364-b0b081c82b78 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:33:51.153032 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-eb3dce5c-bc7f-41ba-8364-b0b081c82b78 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9" status: 200 len: 1211 microversion: 2.1 time: 0.094711 Jul 31 14:33:51.153609 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 504/981] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:33:51 2022] GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9 => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:33:52.173902 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-1a45208b-3949-41ae-825d-b4ceeb63c944 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:52.174519 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-1a45208b-3949-41ae-825d-b4ceeb63c944 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: ea499741-0bd8-4766-b692-1894c085cfc9] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:52.181662 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1a45208b-3949-41ae-825d-b4ceeb63c944 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:52.182327 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1a45208b-3949-41ae-825d-b4ceeb63c944 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:52.183357 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1a45208b-3949-41ae-825d-b4ceeb63c944 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:52.183824 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1a45208b-3949-41ae-825d-b4ceeb63c944 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:52.376393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-1a45208b-3949-41ae-825d-b4ceeb63c944 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:33:52.384111 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-1a45208b-3949-41ae-825d-b4ceeb63c944 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9" status: 200 len: 1279 microversion: 2.1 time: 0.214016 Jul 31 14:33:52.384702 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 478/982] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:33:52 2022] GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9 => generated 1279 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:33:52.417288 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-4778e7e3-78ef-47a4-a4c2-8faa3d0526f8 req-2f829f40-0c2f-42d1-b325-15160702a4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea499741-0bd8-4766-b692-1894c085cfc9", "tag": "4c14b0bd-17df-4ab8-a404-fedf7ab7cc23"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:33:52.426976 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-4778e7e3-78ef-47a4-a4c2-8faa3d0526f8 req-2f829f40-0c2f-42d1-b325-15160702a4f9 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:52.427728 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-4778e7e3-78ef-47a4-a4c2-8faa3d0526f8 req-2f829f40-0c2f-42d1-b325-15160702a4f9 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:52.439153 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-4778e7e3-78ef-47a4-a4c2-8faa3d0526f8 req-2f829f40-0c2f-42d1-b325-15160702a4f9 service nova] Creating event network-changed:4c14b0bd-17df-4ab8-a404-fedf7ab7cc23 for instance ea499741-0bd8-4766-b692-1894c085cfc9 on hv-cinder-84984 Jul 31 14:33:52.443960 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-4778e7e3-78ef-47a4-a4c2-8faa3d0526f8 req-2f829f40-0c2f-42d1-b325-15160702a4f9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030276 Jul 31 14:33:52.444821 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 505/983] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:33:53.405121 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-de92c3af-1263-4965-bf9f-78bfa14262b6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:53.405667 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-de92c3af-1263-4965-bf9f-78bfa14262b6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: ea499741-0bd8-4766-b692-1894c085cfc9] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:53.414525 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-de92c3af-1263-4965-bf9f-78bfa14262b6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:53.415815 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-de92c3af-1263-4965-bf9f-78bfa14262b6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:53.417396 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-de92c3af-1263-4965-bf9f-78bfa14262b6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:53.417829 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-de92c3af-1263-4965-bf9f-78bfa14262b6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:53.591755 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-de92c3af-1263-4965-bf9f-78bfa14262b6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:33:53.599121 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-de92c3af-1263-4965-bf9f-78bfa14262b6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9" status: 200 len: 1279 microversion: 2.1 time: 0.198004 Jul 31 14:33:53.599708 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 479/984] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:33:53 2022] GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9 => generated 1279 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:33:54.512994 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6288a0d9-0b0d-461f-a96d-bab53237732c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:54.515488 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6288a0d9-0b0d-461f-a96d-bab53237732c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:54.522207 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6288a0d9-0b0d-461f-a96d-bab53237732c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:54.522651 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6288a0d9-0b0d-461f-a96d-bab53237732c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:54.523400 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6288a0d9-0b0d-461f-a96d-bab53237732c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:54.523850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6288a0d9-0b0d-461f-a96d-bab53237732c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:54.552468 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6288a0d9-0b0d-461f-a96d-bab53237732c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044079 Jul 31 14:33:54.552925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 506/985] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Jul 31 14:33:54 2022] GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:33:54.563329 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-2e07de95-2a09-4741-92c5-4541c5c3e965 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:54.563869 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-2e07de95-2a09-4741-92c5-4541c5c3e965 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:54.570966 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2e07de95-2a09-4741-92c5-4541c5c3e965 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:54.571412 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2e07de95-2a09-4741-92c5-4541c5c3e965 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:54.572203 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2e07de95-2a09-4741-92c5-4541c5c3e965 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:54.572643 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2e07de95-2a09-4741-92c5-4541c5c3e965 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:54.600319 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-2e07de95-2a09-4741-92c5-4541c5c3e965 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-volume_attachments/9c2fbf4b-b25c-4b26-9a4b-a192953ad75e" status: 200 len: 194 microversion: 2.1 time: 0.040935 Jul 31 14:33:54.600894 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 480/986] 10.222.0.40 () {58 vars in 1413 bytes} [Sun Jul 31 14:33:54 2022] GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-volume_attachments/9c2fbf4b-b25c-4b26-9a4b-a192953ad75e => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:33:54.619348 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b61f1eff-1ecb-49fe-8336-4f558377cd8c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:54.619986 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b61f1eff-1ecb-49fe-8336-4f558377cd8c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: ea499741-0bd8-4766-b692-1894c085cfc9] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:54.625950 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b61f1eff-1ecb-49fe-8336-4f558377cd8c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:54.626395 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b61f1eff-1ecb-49fe-8336-4f558377cd8c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:54.627153 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b61f1eff-1ecb-49fe-8336-4f558377cd8c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:54.627615 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b61f1eff-1ecb-49fe-8336-4f558377cd8c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:54.763191 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b61f1eff-1ecb-49fe-8336-4f558377cd8c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:33:54.770808 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b61f1eff-1ecb-49fe-8336-4f558377cd8c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9" status: 200 len: 1267 microversion: 2.1 time: 0.155209 Jul 31 14:33:54.771724 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 507/987] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:33:54 2022] GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:33:55.791786 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-255abad1-d0ec-4780-9589-96ee632859b6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:55.792392 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-255abad1-d0ec-4780-9589-96ee632859b6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: ea499741-0bd8-4766-b692-1894c085cfc9] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:55.798829 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-255abad1-d0ec-4780-9589-96ee632859b6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:55.799268 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-255abad1-d0ec-4780-9589-96ee632859b6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:55.800057 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-255abad1-d0ec-4780-9589-96ee632859b6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:55.800487 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-255abad1-d0ec-4780-9589-96ee632859b6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:55.944867 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-255abad1-d0ec-4780-9589-96ee632859b6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:33:55.949197 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-28a0ec92-55dc-4df7-9b86-af4e9e861b1e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5ce52f3-f241-4e90-b1a2-2eacf490851d"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:33:55.952372 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-28a0ec92-55dc-4df7-9b86-af4e9e861b1e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:55.952694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-255abad1-d0ec-4780-9589-96ee632859b6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9" status: 200 len: 1267 microversion: 2.1 time: 0.164811 Jul 31 14:33:55.953264 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 481/988] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:33:55 2022] GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:33:55.959677 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-28a0ec92-55dc-4df7-9b86-af4e9e861b1e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:55.960204 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-28a0ec92-55dc-4df7-9b86-af4e9e861b1e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:55.961054 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-28a0ec92-55dc-4df7-9b86-af4e9e861b1e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:55.961565 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-28a0ec92-55dc-4df7-9b86-af4e9e861b1e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:56.210845 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-28a0ec92-55dc-4df7-9b86-af4e9e861b1e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "POST /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265373 Jul 31 14:33:56.211475 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 508/989] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Jul 31 14:33:55 2022] POST /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:33:56.974760 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-19c0e282-1dbc-48d8-98c4-8c3757944337 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:56.975376 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-19c0e282-1dbc-48d8-98c4-8c3757944337 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: ea499741-0bd8-4766-b692-1894c085cfc9] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:56.981979 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-19c0e282-1dbc-48d8-98c4-8c3757944337 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:56.982484 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-19c0e282-1dbc-48d8-98c4-8c3757944337 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:56.983537 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-19c0e282-1dbc-48d8-98c4-8c3757944337 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:56.983988 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-19c0e282-1dbc-48d8-98c4-8c3757944337 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:57.182600 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-19c0e282-1dbc-48d8-98c4-8c3757944337 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:33:57.191914 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-19c0e282-1dbc-48d8-98c4-8c3757944337 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9" status: 200 len: 1267 microversion: 2.1 time: 0.220481 Jul 31 14:33:57.194216 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 482/990] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:33:56 2022] GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9 => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:33:58.217080 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-cf73d1ff-7ed1-49d9-925f-00edfcd030ae tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:58.217775 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-cf73d1ff-7ed1-49d9-925f-00edfcd030ae tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: ea499741-0bd8-4766-b692-1894c085cfc9] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:58.224592 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cf73d1ff-7ed1-49d9-925f-00edfcd030ae tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:58.225039 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cf73d1ff-7ed1-49d9-925f-00edfcd030ae tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:58.225825 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cf73d1ff-7ed1-49d9-925f-00edfcd030ae tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:58.226276 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-cf73d1ff-7ed1-49d9-925f-00edfcd030ae tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:58.360787 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-cf73d1ff-7ed1-49d9-925f-00edfcd030ae tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:33:58.368142 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-cf73d1ff-7ed1-49d9-925f-00edfcd030ae tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9" status: 200 len: 1267 microversion: 2.1 time: 0.155789 Jul 31 14:33:58.368710 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 509/991] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:33:58 2022] GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:33:59.388926 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-977f97c8-9008-4cf2-ab10-6eb35e134deb tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:33:59.389570 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-977f97c8-9008-4cf2-ab10-6eb35e134deb tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: ea499741-0bd8-4766-b692-1894c085cfc9] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:33:59.396366 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-977f97c8-9008-4cf2-ab10-6eb35e134deb tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:59.396817 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-977f97c8-9008-4cf2-ab10-6eb35e134deb tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:59.397584 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-977f97c8-9008-4cf2-ab10-6eb35e134deb tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:33:59.398017 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-977f97c8-9008-4cf2-ab10-6eb35e134deb tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:33:59.528484 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-977f97c8-9008-4cf2-ab10-6eb35e134deb tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:33:59.536530 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-977f97c8-9008-4cf2-ab10-6eb35e134deb tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9" status: 200 len: 1267 microversion: 2.1 time: 0.151482 Jul 31 14:33:59.537095 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 483/992] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:33:59 2022] GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:34:00.556754 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8c77ab58-90c0-4052-bf29-fb3967acf24b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:34:00.557364 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8c77ab58-90c0-4052-bf29-fb3967acf24b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: ea499741-0bd8-4766-b692-1894c085cfc9] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:34:00.559783 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:34:00.560453 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=6 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:34:00.566899 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8c77ab58-90c0-4052-bf29-fb3967acf24b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:00.567343 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8c77ab58-90c0-4052-bf29-fb3967acf24b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:00.568131 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8c77ab58-90c0-4052-bf29-fb3967acf24b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:00.568567 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8c77ab58-90c0-4052-bf29-fb3967acf24b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:00.696305 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8c77ab58-90c0-4052-bf29-fb3967acf24b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:34:00.703978 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8c77ab58-90c0-4052-bf29-fb3967acf24b tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9" status: 200 len: 1267 microversion: 2.1 time: 0.151091 Jul 31 14:34:00.704546 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 510/993] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:34:00 2022] GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:34:01.724742 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-c2e7e27c-98d8-4204-ab5e-4deef3142b79 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:34:01.725442 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-c2e7e27c-98d8-4204-ab5e-4deef3142b79 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: ea499741-0bd8-4766-b692-1894c085cfc9] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:34:01.727413 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:34:01.733131 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c2e7e27c-98d8-4204-ab5e-4deef3142b79 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:01.733580 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c2e7e27c-98d8-4204-ab5e-4deef3142b79 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:01.734344 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c2e7e27c-98d8-4204-ab5e-4deef3142b79 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:01.734779 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c2e7e27c-98d8-4204-ab5e-4deef3142b79 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:01.869034 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c2e7e27c-98d8-4204-ab5e-4deef3142b79 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:34:01.876409 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-c2e7e27c-98d8-4204-ab5e-4deef3142b79 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9" status: 200 len: 1267 microversion: 2.1 time: 0.155625 Jul 31 14:34:01.876984 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 484/994] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:34:01 2022] GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:34:02.897914 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a49489da-8288-4828-9107-cdeda914f64a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:34:02.898534 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a49489da-8288-4828-9107-cdeda914f64a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: ea499741-0bd8-4766-b692-1894c085cfc9] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:34:02.904971 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a49489da-8288-4828-9107-cdeda914f64a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:02.905425 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a49489da-8288-4828-9107-cdeda914f64a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:02.906195 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a49489da-8288-4828-9107-cdeda914f64a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:02.906639 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a49489da-8288-4828-9107-cdeda914f64a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:03.047839 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a49489da-8288-4828-9107-cdeda914f64a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:34:03.055828 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a49489da-8288-4828-9107-cdeda914f64a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9" status: 200 len: 1267 microversion: 2.1 time: 0.162241 Jul 31 14:34:03.056424 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 511/995] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:34:02 2022] GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:34:03.250105 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-f05eb907-3eb3-42db-8d6e-e55152e833c0 req-41a68b81-df8f-4c4f-b6d7-ac8af3571fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea499741-0bd8-4766-b692-1894c085cfc9", "name": "network-vif-plugged", "status": "completed", "tag": "4c14b0bd-17df-4ab8-a404-fedf7ab7cc23"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:34:03.261645 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-f05eb907-3eb3-42db-8d6e-e55152e833c0 req-41a68b81-df8f-4c4f-b6d7-ac8af3571fe2 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:03.262185 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-f05eb907-3eb3-42db-8d6e-e55152e833c0 req-41a68b81-df8f-4c4f-b6d7-ac8af3571fe2 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:03.273693 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-f05eb907-3eb3-42db-8d6e-e55152e833c0 req-41a68b81-df8f-4c4f-b6d7-ac8af3571fe2 service nova] Creating event network-vif-plugged:4c14b0bd-17df-4ab8-a404-fedf7ab7cc23 for instance ea499741-0bd8-4766-b692-1894c085cfc9 on hv-cinder-84984 Jul 31 14:34:03.278587 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-f05eb907-3eb3-42db-8d6e-e55152e833c0 req-41a68b81-df8f-4c4f-b6d7-ac8af3571fe2 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095643 Jul 31 14:34:03.279260 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 485/996] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:34:03.731687 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-464b883a-c627-470a-b08f-302d541f170b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:34:03.733932 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-464b883a-c627-470a-b08f-302d541f170b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:34:03.740523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-464b883a-c627-470a-b08f-302d541f170b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:03.740970 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-464b883a-c627-470a-b08f-302d541f170b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:03.741731 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-464b883a-c627-470a-b08f-302d541f170b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:03.742171 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-464b883a-c627-470a-b08f-302d541f170b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:03.772245 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-464b883a-c627-470a-b08f-302d541f170b tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044424 Jul 31 14:34:03.772729 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 512/997] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Jul 31 14:34:03 2022] GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:34:03.917790 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-9c14b8ab-57b8-4f66-8187-9beb529d4271 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:34:03.918373 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-9c14b8ab-57b8-4f66-8187-9beb529d4271 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:34:03.925988 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9c14b8ab-57b8-4f66-8187-9beb529d4271 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:03.926442 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9c14b8ab-57b8-4f66-8187-9beb529d4271 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:03.927210 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9c14b8ab-57b8-4f66-8187-9beb529d4271 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:03.927763 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9c14b8ab-57b8-4f66-8187-9beb529d4271 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:03.956494 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-9c14b8ab-57b8-4f66-8187-9beb529d4271 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-volume_attachments/9c2fbf4b-b25c-4b26-9a4b-a192953ad75e" status: 200 len: 194 microversion: 2.1 time: 0.043060 Jul 31 14:34:03.957072 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 486/998] 10.222.0.40 () {58 vars in 1413 bytes} [Sun Jul 31 14:34:03 2022] GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-volume_attachments/9c2fbf4b-b25c-4b26-9a4b-a192953ad75e => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:34:03.967641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8aa95bb6-bcfc-4bce-ab42-1f9087f51fbd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:34:03.968129 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8aa95bb6-bcfc-4bce-ab42-1f9087f51fbd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:34:03.975024 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8aa95bb6-bcfc-4bce-ab42-1f9087f51fbd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:03.975523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8aa95bb6-bcfc-4bce-ab42-1f9087f51fbd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:03.976320 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8aa95bb6-bcfc-4bce-ab42-1f9087f51fbd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:03.976784 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-8aa95bb6-bcfc-4bce-ab42-1f9087f51fbd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:04.055375 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-8aa95bb6-bcfc-4bce-ab42-1f9087f51fbd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lazy-loading 'services' on Instance uuid f36be164-718f-4738-bb6c-6a5618f80fdd {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:34:04.077197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-9fc610e0-e8de-442d-b3b7-f19362bbebce tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:34:04.077919 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-9fc610e0-e8de-442d-b3b7-f19362bbebce tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: ea499741-0bd8-4766-b692-1894c085cfc9] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:34:04.084000 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9fc610e0-e8de-442d-b3b7-f19362bbebce tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:04.084453 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9fc610e0-e8de-442d-b3b7-f19362bbebce tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:04.085220 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9fc610e0-e8de-442d-b3b7-f19362bbebce tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:04.085659 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9fc610e0-e8de-442d-b3b7-f19362bbebce tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:04.116791 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:34:04.129901 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8aa95bb6-bcfc-4bce-ab42-1f9087f51fbd tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-volume_attachments/9c2fbf4b-b25c-4b26-9a4b-a192953ad75e" status: 202 len: 0 microversion: 2.1 time: 0.165978 Jul 31 14:34:04.130733 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 513/999] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Jul 31 14:34:03 2022] DELETE /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-volume_attachments/9c2fbf4b-b25c-4b26-9a4b-a192953ad75e => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:34:04.230454 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-9fc610e0-e8de-442d-b3b7-f19362bbebce tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:34:04.238830 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-9fc610e0-e8de-442d-b3b7-f19362bbebce tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9" status: 200 len: 1267 microversion: 2.1 time: 0.166245 Jul 31 14:34:04.239457 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 487/1000] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:34:04 2022] GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:34:05.260923 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f3e67100-c4b8-43b7-902d-59084ebb03db tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:34:05.261630 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f3e67100-c4b8-43b7-902d-59084ebb03db tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: ea499741-0bd8-4766-b692-1894c085cfc9] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:34:05.268185 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f3e67100-c4b8-43b7-902d-59084ebb03db tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:05.269135 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f3e67100-c4b8-43b7-902d-59084ebb03db tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:05.269902 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f3e67100-c4b8-43b7-902d-59084ebb03db tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:05.270341 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f3e67100-c4b8-43b7-902d-59084ebb03db tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:05.402863 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f3e67100-c4b8-43b7-902d-59084ebb03db tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:34:05.411141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f3e67100-c4b8-43b7-902d-59084ebb03db tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9" status: 200 len: 1455 microversion: 2.1 time: 0.155295 Jul 31 14:34:05.411751 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 514/1001] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:34:05 2022] GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9 => generated 1455 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:34:05.431990 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-6c1fffa4-fa70-43a2-b285-68bef7342625 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:34:05.432616 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-6c1fffa4-fa70-43a2-b285-68bef7342625 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: ea499741-0bd8-4766-b692-1894c085cfc9] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:34:05.439597 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6c1fffa4-fa70-43a2-b285-68bef7342625 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:05.440111 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6c1fffa4-fa70-43a2-b285-68bef7342625 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:05.441546 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6c1fffa4-fa70-43a2-b285-68bef7342625 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:05.442045 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6c1fffa4-fa70-43a2-b285-68bef7342625 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:05.575059 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-6c1fffa4-fa70-43a2-b285-68bef7342625 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:34:05.583407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-6c1fffa4-fa70-43a2-b285-68bef7342625 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9" status: 200 len: 1455 microversion: 2.1 time: 0.155345 Jul 31 14:34:05.584028 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 488/1002] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:34:05 2022] GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9 => generated 1455 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:34:06.317170 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-248a2891-e574-418e-a706-eb4dd02b5c0e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:34:06.317715 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-248a2891-e574-418e-a706-eb4dd02b5c0e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:34:06.324141 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-248a2891-e574-418e-a706-eb4dd02b5c0e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:06.324599 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-248a2891-e574-418e-a706-eb4dd02b5c0e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:06.325373 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-248a2891-e574-418e-a706-eb4dd02b5c0e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:06.325816 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-248a2891-e574-418e-a706-eb4dd02b5c0e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:06.356138 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-248a2891-e574-418e-a706-eb4dd02b5c0e tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-volume_attachments/a5ce52f3-f241-4e90-b1a2-2eacf490851d" status: 200 len: 194 microversion: 2.1 time: 0.042944 Jul 31 14:34:06.356928 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 515/1003] 10.222.0.40 () {58 vars in 1413 bytes} [Sun Jul 31 14:34:06 2022] GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-volume_attachments/a5ce52f3-f241-4e90-b1a2-2eacf490851d => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:34:06.368017 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7fdec779-d1f1-4d0a-bdaa-7ec5e781ebc9 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:34:06.368514 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7fdec779-d1f1-4d0a-bdaa-7ec5e781ebc9 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:34:06.374765 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7fdec779-d1f1-4d0a-bdaa-7ec5e781ebc9 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:06.375219 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7fdec779-d1f1-4d0a-bdaa-7ec5e781ebc9 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:06.376037 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7fdec779-d1f1-4d0a-bdaa-7ec5e781ebc9 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:06.376479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7fdec779-d1f1-4d0a-bdaa-7ec5e781ebc9 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:06.463668 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.objects.instance [None req-7fdec779-d1f1-4d0a-bdaa-7ec5e781ebc9 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lazy-loading 'services' on Instance uuid f36be164-718f-4738-bb6c-6a5618f80fdd {{(pid=117781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:34:06.540679 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7fdec779-d1f1-4d0a-bdaa-7ec5e781ebc9 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-volume_attachments/a5ce52f3-f241-4e90-b1a2-2eacf490851d" status: 202 len: 0 microversion: 2.1 time: 0.176485 Jul 31 14:34:06.541870 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 489/1004] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Jul 31 14:34:06 2022] DELETE /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-volume_attachments/a5ce52f3-f241-4e90-b1a2-2eacf490851d => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 14:34:07.445435 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-5a775a1e-de68-4b43-9e2e-65e457580e06 req-be3251c6-55cc-4e3c-8eb8-032e13cf6aae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea499741-0bd8-4766-b692-1894c085cfc9", "tag": "4c14b0bd-17df-4ab8-a404-fedf7ab7cc23"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:34:07.455715 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-5a775a1e-de68-4b43-9e2e-65e457580e06 req-be3251c6-55cc-4e3c-8eb8-032e13cf6aae service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:07.456165 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-5a775a1e-de68-4b43-9e2e-65e457580e06 req-be3251c6-55cc-4e3c-8eb8-032e13cf6aae service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:07.467782 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-5a775a1e-de68-4b43-9e2e-65e457580e06 req-be3251c6-55cc-4e3c-8eb8-032e13cf6aae service nova] Creating event network-changed:4c14b0bd-17df-4ab8-a404-fedf7ab7cc23 for instance ea499741-0bd8-4766-b692-1894c085cfc9 on hv-cinder-84984 Jul 31 14:34:07.472785 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-5a775a1e-de68-4b43-9e2e-65e457580e06 req-be3251c6-55cc-4e3c-8eb8-032e13cf6aae service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031443 Jul 31 14:34:07.473496 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 516/1005] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:34:07.730570 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-a94b9527-7937-473d-907a-a31194bc1a5a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:34:07.732879 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-a94b9527-7937-473d-907a-a31194bc1a5a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:34:07.739723 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a94b9527-7937-473d-907a-a31194bc1a5a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:07.740178 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a94b9527-7937-473d-907a-a31194bc1a5a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:07.740941 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a94b9527-7937-473d-907a-a31194bc1a5a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:07.741375 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a94b9527-7937-473d-907a-a31194bc1a5a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:07.745111 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:34:07.773841 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-a94b9527-7937-473d-907a-a31194bc1a5a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048205 Jul 31 14:34:07.774671 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 490/1006] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Jul 31 14:34:07 2022] GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 14:34:07.896261 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a38c8f26-c865-4ba5-81a1-22303e33c09c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:34:07.898720 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a38c8f26-c865-4ba5-81a1-22303e33c09c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:34:07.905262 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a38c8f26-c865-4ba5-81a1-22303e33c09c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:07.905640 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a38c8f26-c865-4ba5-81a1-22303e33c09c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:07.906413 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a38c8f26-c865-4ba5-81a1-22303e33c09c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:07.906977 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a38c8f26-c865-4ba5-81a1-22303e33c09c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:07.939456 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a38c8f26-c865-4ba5-81a1-22303e33c09c tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047524 Jul 31 14:34:07.940325 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 517/1007] 10.222.0.40 () {58 vars in 1302 bytes} [Sun Jul 31 14:34:07 2022] GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 31 14:34:08.009125 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-1ed31a54-bea3-4222-8331-bd67e7bf5ea1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:34:08.009900 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-1ed31a54-bea3-4222-8331-bd67e7bf5ea1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:34:08.016508 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1ed31a54-bea3-4222-8331-bd67e7bf5ea1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:08.016968 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1ed31a54-bea3-4222-8331-bd67e7bf5ea1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:08.017744 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1ed31a54-bea3-4222-8331-bd67e7bf5ea1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:08.018369 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1ed31a54-bea3-4222-8331-bd67e7bf5ea1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:08.048282 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-1ed31a54-bea3-4222-8331-bd67e7bf5ea1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Going to try to terminate instance {{(pid=117781) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 14:34:08.137956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-1ed31a54-bea3-4222-8331-bd67e7bf5ea1 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd" status: 204 len: 0 microversion: 2.1 time: 0.132452 Jul 31 14:34:08.138545 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 491/1008] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:34:08 2022] DELETE /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 14:34:08.148061 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f57fbf6d-8ab6-43c8-8169-f5a47670a011 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:34:08.148580 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f57fbf6d-8ab6-43c8-8169-f5a47670a011 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:34:08.154717 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f57fbf6d-8ab6-43c8-8169-f5a47670a011 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:08.155595 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f57fbf6d-8ab6-43c8-8169-f5a47670a011 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:08.156545 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f57fbf6d-8ab6-43c8-8169-f5a47670a011 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:08.156981 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f57fbf6d-8ab6-43c8-8169-f5a47670a011 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:08.290743 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-f57fbf6d-8ab6-43c8-8169-f5a47670a011 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:34:08.298444 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f57fbf6d-8ab6-43c8-8169-f5a47670a011 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd" status: 200 len: 1674 microversion: 2.1 time: 0.155489 Jul 31 14:34:08.299024 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 518/1009] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:34:08 2022] GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:34:09.320741 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7ea936e7-60b4-4890-b003-fb370c723b36 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:34:09.321431 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7ea936e7-60b4-4890-b003-fb370c723b36 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:34:09.328190 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7ea936e7-60b4-4890-b003-fb370c723b36 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:09.328641 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7ea936e7-60b4-4890-b003-fb370c723b36 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:09.329395 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7ea936e7-60b4-4890-b003-fb370c723b36 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:09.329828 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7ea936e7-60b4-4890-b003-fb370c723b36 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:09.460861 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-7ea936e7-60b4-4890-b003-fb370c723b36 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:34:09.468256 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7ea936e7-60b4-4890-b003-fb370c723b36 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd" status: 200 len: 1674 microversion: 2.1 time: 0.151736 Jul 31 14:34:09.468824 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 492/1010] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:34:09 2022] GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:34:10.490301 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-ddc3c94b-0f93-4148-b265-9d9c8ad1f0a3 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:34:10.490915 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-ddc3c94b-0f93-4148-b265-9d9c8ad1f0a3 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:34:10.497524 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ddc3c94b-0f93-4148-b265-9d9c8ad1f0a3 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:10.497971 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ddc3c94b-0f93-4148-b265-9d9c8ad1f0a3 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:10.498741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ddc3c94b-0f93-4148-b265-9d9c8ad1f0a3 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:10.499178 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-ddc3c94b-0f93-4148-b265-9d9c8ad1f0a3 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:10.566455 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-ddc3c94b-0f93-4148-b265-9d9c8ad1f0a3 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d69118a87374b14b0f85a23979d5264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eec425dcc93489d9db53600cb95458d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:34:10.573948 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-ddc3c94b-0f93-4148-b265-9d9c8ad1f0a3 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd" status: 200 len: 1606 microversion: 2.1 time: 0.087586 Jul 31 14:34:10.574524 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 519/1011] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:34:10 2022] GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd => generated 1606 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:34:10.690660 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-b79b85c6-9bd5-451e-a3c8-75290c42099d req-bf331c47-d781-4944-bad7-015fb2f68478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f36be164-718f-4738-bb6c-6a5618f80fdd", "name": "network-vif-deleted", "tag": "1a0c7b25-db13-439d-92e3-5da8e6c0ab55"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:34:10.705673 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-b79b85c6-9bd5-451e-a3c8-75290c42099d req-bf331c47-d781-4944-bad7-015fb2f68478 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:10.706103 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-b79b85c6-9bd5-451e-a3c8-75290c42099d req-bf331c47-d781-4944-bad7-015fb2f68478 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:10.718528 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-b79b85c6-9bd5-451e-a3c8-75290c42099d req-bf331c47-d781-4944-bad7-015fb2f68478 service nova] Creating event network-vif-deleted:1a0c7b25-db13-439d-92e3-5da8e6c0ab55 for instance f36be164-718f-4738-bb6c-6a5618f80fdd on hv-cinder-84984 Jul 31 14:34:10.724933 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-b79b85c6-9bd5-451e-a3c8-75290c42099d req-bf331c47-d781-4944-bad7-015fb2f68478 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037574 Jul 31 14:34:10.725549 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 493/1012] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:34:11.595461 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-eb22eb78-be99-41a0-ac89-33a2dc0cf703 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:34:11.596068 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-eb22eb78-be99-41a0-ac89-33a2dc0cf703 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:34:11.602558 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-eb22eb78-be99-41a0-ac89-33a2dc0cf703 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:11.603003 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-eb22eb78-be99-41a0-ac89-33a2dc0cf703 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:11.603935 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-eb22eb78-be99-41a0-ac89-33a2dc0cf703 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:11.604367 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-eb22eb78-be99-41a0-ac89-33a2dc0cf703 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:11.618756 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-eb22eb78-be99-41a0-ac89-33a2dc0cf703 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] HTTP exception thrown: Instance f36be164-718f-4738-bb6c-6a5618f80fdd could not be found. Jul 31 14:34:11.620445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-eb22eb78-be99-41a0-ac89-33a2dc0cf703 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Request method failure captured: Jul 31 14:34:11.620445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd HTTP/1.1 Jul 31 14:34:11.620445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:34:11.620445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:34:11.620445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:34:11.620445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:34:11.620445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:34:11.620445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:34:11.620445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:34:11.620445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:34:11.620445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pHuOWCyOotqNPNhz6dH05EdJdRYcX3dTCZq4K6trbt6bcr_x2T83Niq8MfUZqVwzUOYnNC8mwfhj8pMnnueA45ZutnJsOvtv6Hr5AuZbYwFx4jRzmyjvO3QdnRT2XQqlWqIM7wolafKeKxZdtpE9m6jhChVIxOZ1g__cgRvnV5wR7w Jul 31 14:34:11.620445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:34:11.620445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:34:11.620445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:34:11.620445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:34:11.620445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:34:11.620445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:34:11.620445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: 1eec425dcc93489d9db53600cb95458d Jul 31 14:34:11.620445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeTestJSON-821291449 Jul 31 14:34:11.620445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:34:11.620445 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:34:11.621863 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1eec425dcc93489d9db53600cb95458d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1eec425dcc93489d9db53600cb95458d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1eec425dcc93489d9db53600cb95458d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1eec425dcc93489d9db53600cb95458d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:34:11.621863 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeTestJSON-821291449 Jul 31 14:34:11.621863 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 1eec425dcc93489d9db53600cb95458d Jul 31 14:34:11.621863 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeTestJSON-821291449 Jul 31 14:34:11.621863 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeTestJSON-821291449-project Jul 31 14:34:11.621863 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:34:11.621863 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:34:11.621863 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: 1d69118a87374b14b0f85a23979d5264 Jul 31 14:34:11.621863 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeTestJSON-821291449-project Jul 31 14:34:11.621863 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:34:11.621863 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance f36be164-718f-4738-bb6c-6a5618f80fdd could not be found. Jul 31 14:34:11.621863 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': 'f36be164-718f-4738-bb6c-6a5618f80fdd'} Jul 31 14:34:11.622667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:34:11.622667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:34:11.622667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:34:11.622667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:34:11.622667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:34:11.622667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:34:11.622667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:34:11.622667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:34:11.622667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:34:11.622667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:34:11.622667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f36be164-718f-4738-bb6c-6a5618f80fdd could not be found. Jul 31 14:34:11.622667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:34:11.622667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:34:11.622667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:34:11.622667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:34:11.622667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:34:11.622667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:34:11.622667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:34:11.622667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:34:11.622667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:34:11.624232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:34:11.624232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:34:11.624232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:34:11.624232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:34:11.624232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:34:11.624232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:34:11.624232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:34:11.624232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f36be164-718f-4738-bb6c-6a5618f80fdd could not be found. Jul 31 14:34:11.624232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:34:11.624232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:34:11.624232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:34:11.624232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:34:11.624232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:34:11.624232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:34:11.624232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:34:11.624232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:34:11.624232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f36be164-718f-4738-bb6c-6a5618f80fdd could not be found. Jul 31 14:34:11.624232 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:34:11.625807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-eb22eb78-be99-41a0-ac89-33a2dc0cf703 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Returning 404 to user: Instance f36be164-718f-4738-bb6c-6a5618f80fdd could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:34:11.625807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-eb22eb78-be99-41a0-ac89-33a2dc0cf703 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd" status: 404 len: 111 microversion: 2.1 time: 0.030264 Jul 31 14:34:11.625807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 520/1013] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:34:11 2022] GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:34:11.632197 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-3ad9d704-9642-462e-9af1-0adfb9b1074a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '.version_select at 0x7f87e9b0c040>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:34:11.651798 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-3ad9d704-9642-462e-9af1-0adfb9b1074a tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2030136901" status: 202 len: 0 microversion: 2.1 time: 0.024310 Jul 31 14:34:11.652502 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 494/1014] 10.222.0.40 () {58 vars in 1221 bytes} [Sun Jul 31 14:34:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2030136901 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:34:14.530414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f0fa927a-ff0e-45b1-8362-1285bcebf441 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:34:14.530960 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f0fa927a-ff0e-45b1-8362-1285bcebf441 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:34:14.537201 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0fa927a-ff0e-45b1-8362-1285bcebf441 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:14.537654 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0fa927a-ff0e-45b1-8362-1285bcebf441 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:14.538414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0fa927a-ff0e-45b1-8362-1285bcebf441 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:14.538852 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f0fa927a-ff0e-45b1-8362-1285bcebf441 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:14.552590 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-f0fa927a-ff0e-45b1-8362-1285bcebf441 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] HTTP exception thrown: Instance f36be164-718f-4738-bb6c-6a5618f80fdd could not be found. Jul 31 14:34:14.554111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f0fa927a-ff0e-45b1-8362-1285bcebf441 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Request method failure captured: Jul 31 14:34:14.554111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: DELETE /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd HTTP/1.1 Jul 31 14:34:14.554111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:34:14.554111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:34:14.554111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:34:14.554111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:34:14.554111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:34:14.554111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:34:14.554111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:34:14.554111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:34:14.554111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pHuOWCyOotqNPNhz6dH05EdJdRYcX3dTCZq4K6trbt6bcr_x2T83Niq8MfUZqVwzUOYnNC8mwfhj8pMnnueA45ZutnJsOvtv6Hr5AuZbYwFx4jRzmyjvO3QdnRT2XQqlWqIM7wolafKeKxZdtpE9m6jhChVIxOZ1g__cgRvnV5wR7w Jul 31 14:34:14.554111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:34:14.554111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:34:14.554111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:34:14.554111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:34:14.554111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:34:14.554111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:34:14.554111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: 1eec425dcc93489d9db53600cb95458d Jul 31 14:34:14.554111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeTestJSON-821291449 Jul 31 14:34:14.554111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:34:14.554111 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:34:14.555723 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1eec425dcc93489d9db53600cb95458d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1eec425dcc93489d9db53600cb95458d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1eec425dcc93489d9db53600cb95458d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1eec425dcc93489d9db53600cb95458d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:34:14.555723 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeTestJSON-821291449 Jul 31 14:34:14.555723 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 1eec425dcc93489d9db53600cb95458d Jul 31 14:34:14.555723 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeTestJSON-821291449 Jul 31 14:34:14.555723 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeTestJSON-821291449-project Jul 31 14:34:14.555723 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:34:14.555723 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:34:14.555723 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: 1d69118a87374b14b0f85a23979d5264 Jul 31 14:34:14.555723 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeTestJSON-821291449-project Jul 31 14:34:14.555723 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:34:14.555723 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance f36be164-718f-4738-bb6c-6a5618f80fdd could not be found. Jul 31 14:34:14.555723 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': 'f36be164-718f-4738-bb6c-6a5618f80fdd'} Jul 31 14:34:14.556649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:34:14.556649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:34:14.556649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:34:14.556649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:34:14.556649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:34:14.556649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:34:14.556649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:34:14.556649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:34:14.556649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:34:14.556649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:34:14.556649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f36be164-718f-4738-bb6c-6a5618f80fdd could not be found. Jul 31 14:34:14.556649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:34:14.556649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:34:14.556649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:34:14.556649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:34:14.556649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:34:14.556649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:34:14.556649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:34:14.556649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:34:14.556649 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:34:14.558099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:34:14.558099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 14:34:14.558099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 14:34:14.558099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 14:34:14.558099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 14:34:14.558099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:34:14.558099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:34:14.558099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:34:14.558099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:34:14.558099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f36be164-718f-4738-bb6c-6a5618f80fdd could not be found. Jul 31 14:34:14.558099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:34:14.558099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:34:14.558099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:34:14.558099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:34:14.558099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:34:14.558099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:34:14.558099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:34:14.558099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:34:14.558099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f36be164-718f-4738-bb6c-6a5618f80fdd could not be found. Jul 31 14:34:14.558099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:34:14.559560 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f0fa927a-ff0e-45b1-8362-1285bcebf441 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Returning 404 to user: Instance f36be164-718f-4738-bb6c-6a5618f80fdd could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:34:14.559560 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f0fa927a-ff0e-45b1-8362-1285bcebf441 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "DELETE /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd" status: 404 len: 111 microversion: 2.1 time: 0.028911 Jul 31 14:34:14.559560 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 521/1015] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:34:14 2022] DELETE /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:34:14.565118 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-aa6b3fbc-18d0-4bcd-8de0-57532e1c2612 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:34:14.565847 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-aa6b3fbc-18d0-4bcd-8de0-57532e1c2612 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: f36be164-718f-4738-bb6c-6a5618f80fdd] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:34:14.568413 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:34:14.574209 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-aa6b3fbc-18d0-4bcd-8de0-57532e1c2612 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:14.574659 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-aa6b3fbc-18d0-4bcd-8de0-57532e1c2612 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:14.575476 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-aa6b3fbc-18d0-4bcd-8de0-57532e1c2612 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:14.575894 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-aa6b3fbc-18d0-4bcd-8de0-57532e1c2612 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:14.591281 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.wsgi [None req-aa6b3fbc-18d0-4bcd-8de0-57532e1c2612 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] HTTP exception thrown: Instance f36be164-718f-4738-bb6c-6a5618f80fdd could not be found. Jul 31 14:34:14.592930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-aa6b3fbc-18d0-4bcd-8de0-57532e1c2612 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Request method failure captured: Jul 31 14:34:14.592930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: request: GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd HTTP/1.1 Jul 31 14:34:14.592930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept: application/json Jul 31 14:34:14.592930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept-Encoding: identity Jul 31 14:34:14.592930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Connection: close Jul 31 14:34:14.592930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Length: 0 Jul 31 14:34:14.592930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Type: application/json Jul 31 14:34:14.592930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Host: 10.222.0.40 Jul 31 14:34:14.592930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Openstack-System-Scope: None Jul 31 14:34:14.592930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: User-Agent: python-urllib3/1.26.10 Jul 31 14:34:14.592930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Auth-Token: gAAAAABi5pHuOWCyOotqNPNhz6dH05EdJdRYcX3dTCZq4K6trbt6bcr_x2T83Niq8MfUZqVwzUOYnNC8mwfhj8pMnnueA45ZutnJsOvtv6Hr5AuZbYwFx4jRzmyjvO3QdnRT2XQqlWqIM7wolafKeKxZdtpE9m6jhChVIxOZ1g__cgRvnV5wR7w Jul 31 14:34:14.592930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Id: None Jul 31 14:34:14.592930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Name: None Jul 31 14:34:14.592930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Identity-Status: Confirmed Jul 31 14:34:14.592930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Is-Admin-Project: True Jul 31 14:34:14.592930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Id: default Jul 31 14:34:14.592930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Name: Default Jul 31 14:34:14.592930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Id: 1eec425dcc93489d9db53600cb95458d Jul 31 14:34:14.592930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Name: tempest-AttachVolumeTestJSON-821291449 Jul 31 14:34:14.592930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Role: reader,member Jul 31 14:34:14.592930 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Roles: reader,member Jul 31 14:34:14.594525 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1eec425dcc93489d9db53600cb95458d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1eec425dcc93489d9db53600cb95458d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1eec425dcc93489d9db53600cb95458d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1eec425dcc93489d9db53600cb95458d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:34:14.594525 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant: tempest-AttachVolumeTestJSON-821291449 Jul 31 14:34:14.594525 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Id: 1eec425dcc93489d9db53600cb95458d Jul 31 14:34:14.594525 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Name: tempest-AttachVolumeTestJSON-821291449 Jul 31 14:34:14.594525 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User: tempest-AttachVolumeTestJSON-821291449-project Jul 31 14:34:14.594525 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Id: default Jul 31 14:34:14.594525 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Name: Default Jul 31 14:34:14.594525 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Id: 1d69118a87374b14b0f85a23979d5264 Jul 31 14:34:14.594525 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Name: tempest-AttachVolumeTestJSON-821291449-project Jul 31 14:34:14.594525 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: method: > Jul 31 14:34:14.594525 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: exception: Instance f36be164-718f-4738-bb6c-6a5618f80fdd could not be found. Jul 31 14:34:14.594525 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: action_args: {'id': 'f36be164-718f-4738-bb6c-6a5618f80fdd'} Jul 31 14:34:14.595407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:34:14.595407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:34:14.595407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:34:14.595407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:34:14.595407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:34:14.595407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:34:14.595407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:34:14.595407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:34:14.595407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:34:14.595407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:34:14.595407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f36be164-718f-4738-bb6c-6a5618f80fdd could not be found. Jul 31 14:34:14.595407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:34:14.595407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:34:14.595407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:34:14.595407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:34:14.595407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:34:14.595407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:34:14.595407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:34:14.595407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:34:14.595407 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:34:14.596928 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:34:14.596928 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:34:14.596928 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:34:14.596928 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:34:14.596928 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:34:14.596928 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:34:14.596928 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:34:14.596928 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f36be164-718f-4738-bb6c-6a5618f80fdd could not be found. Jul 31 14:34:14.596928 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:34:14.596928 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:34:14.596928 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:34:14.596928 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:34:14.596928 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:34:14.596928 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:34:14.596928 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:34:14.596928 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:34:14.596928 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f36be164-718f-4738-bb6c-6a5618f80fdd could not be found. Jul 31 14:34:14.596928 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:34:14.598268 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-aa6b3fbc-18d0-4bcd-8de0-57532e1c2612 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Returning 404 to user: Instance f36be164-718f-4738-bb6c-6a5618f80fdd could not be found. {{(pid=117781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:34:14.598268 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-aa6b3fbc-18d0-4bcd-8de0-57532e1c2612 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd" status: 404 len: 111 microversion: 2.1 time: 0.033727 Jul 31 14:34:14.598268 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 495/1016] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:34:14 2022] GET /compute/v2.1/servers/f36be164-718f-4738-bb6c-6a5618f80fdd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:34:15.731784 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-afc61089-4a1c-4e05-8d7d-f96442df43fa tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:34:15.732280 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-afc61089-4a1c-4e05-8d7d-f96442df43fa tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:34:15.734710 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:34:15.740039 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-afc61089-4a1c-4e05-8d7d-f96442df43fa tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:15.740493 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-afc61089-4a1c-4e05-8d7d-f96442df43fa tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:15.741264 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-afc61089-4a1c-4e05-8d7d-f96442df43fa tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:15.741707 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-afc61089-4a1c-4e05-8d7d-f96442df43fa tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:15.756418 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-afc61089-4a1c-4e05-8d7d-f96442df43fa tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] HTTP exception thrown: Instance 942db3cc-e948-4ef3-9dd1-381f74a0bbad could not be found. Jul 31 14:34:15.757969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-afc61089-4a1c-4e05-8d7d-f96442df43fa tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Request method failure captured: Jul 31 14:34:15.757969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: DELETE /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad HTTP/1.1 Jul 31 14:34:15.757969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:34:15.757969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:34:15.757969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:34:15.757969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:34:15.757969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:34:15.757969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:34:15.757969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:34:15.757969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:34:15.757969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pHuOWCyOotqNPNhz6dH05EdJdRYcX3dTCZq4K6trbt6bcr_x2T83Niq8MfUZqVwzUOYnNC8mwfhj8pMnnueA45ZutnJsOvtv6Hr5AuZbYwFx4jRzmyjvO3QdnRT2XQqlWqIM7wolafKeKxZdtpE9m6jhChVIxOZ1g__cgRvnV5wR7w Jul 31 14:34:15.757969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:34:15.757969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:34:15.757969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:34:15.757969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:34:15.757969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:34:15.757969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:34:15.757969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: 1eec425dcc93489d9db53600cb95458d Jul 31 14:34:15.757969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-AttachVolumeTestJSON-821291449 Jul 31 14:34:15.757969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:34:15.757969 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:34:15.759582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1eec425dcc93489d9db53600cb95458d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1eec425dcc93489d9db53600cb95458d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1eec425dcc93489d9db53600cb95458d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1eec425dcc93489d9db53600cb95458d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:34:15.759582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-AttachVolumeTestJSON-821291449 Jul 31 14:34:15.759582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 1eec425dcc93489d9db53600cb95458d Jul 31 14:34:15.759582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-AttachVolumeTestJSON-821291449 Jul 31 14:34:15.759582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-AttachVolumeTestJSON-821291449-project Jul 31 14:34:15.759582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:34:15.759582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:34:15.759582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: 1d69118a87374b14b0f85a23979d5264 Jul 31 14:34:15.759582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-AttachVolumeTestJSON-821291449-project Jul 31 14:34:15.759582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:34:15.759582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance 942db3cc-e948-4ef3-9dd1-381f74a0bbad could not be found. Jul 31 14:34:15.759582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': '942db3cc-e948-4ef3-9dd1-381f74a0bbad'} Jul 31 14:34:15.760414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:34:15.760414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:34:15.760414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:34:15.760414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:34:15.760414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:34:15.760414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:34:15.760414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:34:15.760414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:34:15.760414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:34:15.760414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:34:15.760414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 942db3cc-e948-4ef3-9dd1-381f74a0bbad could not be found. Jul 31 14:34:15.760414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:34:15.760414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:34:15.760414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:34:15.760414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:34:15.760414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:34:15.760414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:34:15.760414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:34:15.760414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:34:15.760414 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:34:15.761641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:34:15.761641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 14:34:15.761641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 14:34:15.761641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 14:34:15.761641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 14:34:15.761641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:34:15.761641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:34:15.761641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:34:15.761641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:34:15.761641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 942db3cc-e948-4ef3-9dd1-381f74a0bbad could not be found. Jul 31 14:34:15.761641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:34:15.761641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:34:15.761641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:34:15.761641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:34:15.761641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:34:15.761641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:34:15.761641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:34:15.761641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:34:15.761641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 942db3cc-e948-4ef3-9dd1-381f74a0bbad could not be found. Jul 31 14:34:15.761641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:34:15.762878 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-afc61089-4a1c-4e05-8d7d-f96442df43fa tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Returning 404 to user: Instance 942db3cc-e948-4ef3-9dd1-381f74a0bbad could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:34:15.762878 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-afc61089-4a1c-4e05-8d7d-f96442df43fa tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "DELETE /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 404 len: 111 microversion: 2.1 time: 0.031454 Jul 31 14:34:15.762878 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 522/1017] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:34:15 2022] DELETE /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:34:15.767677 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-3a789206-d8ab-417f-b745-85fc409ad804 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:34:15.768292 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-3a789206-d8ab-417f-b745-85fc409ad804 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] [instance: 942db3cc-e948-4ef3-9dd1-381f74a0bbad] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:34:15.775571 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3a789206-d8ab-417f-b745-85fc409ad804 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:15.776025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3a789206-d8ab-417f-b745-85fc409ad804 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:15.776795 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3a789206-d8ab-417f-b745-85fc409ad804 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:34:15.777232 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-3a789206-d8ab-417f-b745-85fc409ad804 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:34:15.790512 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.wsgi [None req-3a789206-d8ab-417f-b745-85fc409ad804 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] HTTP exception thrown: Instance 942db3cc-e948-4ef3-9dd1-381f74a0bbad could not be found. Jul 31 14:34:15.792075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-3a789206-d8ab-417f-b745-85fc409ad804 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Request method failure captured: Jul 31 14:34:15.792075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: request: GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad HTTP/1.1 Jul 31 14:34:15.792075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept: application/json Jul 31 14:34:15.792075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept-Encoding: identity Jul 31 14:34:15.792075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Connection: close Jul 31 14:34:15.792075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Length: 0 Jul 31 14:34:15.792075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Type: application/json Jul 31 14:34:15.792075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Host: 10.222.0.40 Jul 31 14:34:15.792075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Openstack-System-Scope: None Jul 31 14:34:15.792075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: User-Agent: python-urllib3/1.26.10 Jul 31 14:34:15.792075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Auth-Token: gAAAAABi5pHuOWCyOotqNPNhz6dH05EdJdRYcX3dTCZq4K6trbt6bcr_x2T83Niq8MfUZqVwzUOYnNC8mwfhj8pMnnueA45ZutnJsOvtv6Hr5AuZbYwFx4jRzmyjvO3QdnRT2XQqlWqIM7wolafKeKxZdtpE9m6jhChVIxOZ1g__cgRvnV5wR7w Jul 31 14:34:15.792075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Id: None Jul 31 14:34:15.792075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Name: None Jul 31 14:34:15.792075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Identity-Status: Confirmed Jul 31 14:34:15.792075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Is-Admin-Project: True Jul 31 14:34:15.792075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Id: default Jul 31 14:34:15.792075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Name: Default Jul 31 14:34:15.792075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Id: 1eec425dcc93489d9db53600cb95458d Jul 31 14:34:15.792075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Name: tempest-AttachVolumeTestJSON-821291449 Jul 31 14:34:15.792075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Role: reader,member Jul 31 14:34:15.792075 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Roles: reader,member Jul 31 14:34:15.793654 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1eec425dcc93489d9db53600cb95458d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_1eec425dcc93489d9db53600cb95458d", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/1eec425dcc93489d9db53600cb95458d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/1eec425dcc93489d9db53600cb95458d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:34:15.793654 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant: tempest-AttachVolumeTestJSON-821291449 Jul 31 14:34:15.793654 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Id: 1eec425dcc93489d9db53600cb95458d Jul 31 14:34:15.793654 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Name: tempest-AttachVolumeTestJSON-821291449 Jul 31 14:34:15.793654 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User: tempest-AttachVolumeTestJSON-821291449-project Jul 31 14:34:15.793654 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Id: default Jul 31 14:34:15.793654 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Name: Default Jul 31 14:34:15.793654 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Id: 1d69118a87374b14b0f85a23979d5264 Jul 31 14:34:15.793654 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Name: tempest-AttachVolumeTestJSON-821291449-project Jul 31 14:34:15.793654 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: method: > Jul 31 14:34:15.793654 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: exception: Instance 942db3cc-e948-4ef3-9dd1-381f74a0bbad could not be found. Jul 31 14:34:15.793654 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: action_args: {'id': '942db3cc-e948-4ef3-9dd1-381f74a0bbad'} Jul 31 14:34:15.794552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:34:15.794552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:34:15.794552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:34:15.794552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:34:15.794552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:34:15.794552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:34:15.794552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:34:15.794552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:34:15.794552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:34:15.794552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:34:15.794552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 942db3cc-e948-4ef3-9dd1-381f74a0bbad could not be found. Jul 31 14:34:15.794552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:34:15.794552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:34:15.794552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:34:15.794552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:34:15.794552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:34:15.794552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:34:15.794552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:34:15.794552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:34:15.794552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:34:15.796054 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:34:15.796054 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:34:15.796054 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:34:15.796054 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:34:15.796054 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:34:15.796054 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:34:15.796054 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:34:15.796054 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 942db3cc-e948-4ef3-9dd1-381f74a0bbad could not be found. Jul 31 14:34:15.796054 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:34:15.796054 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:34:15.796054 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:34:15.796054 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:34:15.796054 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:34:15.796054 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:34:15.796054 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:34:15.796054 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:34:15.796054 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 942db3cc-e948-4ef3-9dd1-381f74a0bbad could not be found. Jul 31 14:34:15.796054 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:34:15.797449 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-3a789206-d8ab-417f-b745-85fc409ad804 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] Returning 404 to user: Instance 942db3cc-e948-4ef3-9dd1-381f74a0bbad could not be found. {{(pid=117781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:34:15.797449 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-3a789206-d8ab-417f-b745-85fc409ad804 tempest-AttachVolumeTestJSON-821291449 tempest-AttachVolumeTestJSON-821291449-project] 10.222.0.40 "GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad" status: 404 len: 111 microversion: 2.1 time: 0.029557 Jul 31 14:34:15.797449 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 496/1018] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:34:15 2022] GET /compute/v2.1/servers/942db3cc-e948-4ef3-9dd1-381f74a0bbad => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 14:34:42.376208 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 14:34:42.376886 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Sun Jul 31 14:34:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 14:35:45.174605 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=38 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:35:45.175330 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:35:45.179767 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-41cb407d-509e-4c72-8684-563a6128e80e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1860050222", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1450971051", "security_groups": [{"name": "tempest-secgroup-smoke-1991941503"}], "block_device_mapping_v2": [{"uuid": "1911e50c-387e-4807-8801-8516ee4443a6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4031262c-bbbd-4f7f-958b-e948963cb0b2"}]}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:35:45.290250 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.network.neutron [None req-41cb407d-509e-4c72-8684-563a6128e80e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] validate_networks() for [('4031262c-bbbd-4f7f-958b-e948963cb0b2', None, None, None, None, None)] {{(pid=117780) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 14:35:45.658100 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-41cb407d-509e-4c72-8684-563a6128e80e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Flavor limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 14:35:45.658526 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-41cb407d-509e-4c72-8684-563a6128e80e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Image limits 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 14:35:45.659026 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-41cb407d-509e-4c72-8684-563a6128e80e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Flavor pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 14:35:45.659478 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-41cb407d-509e-4c72-8684-563a6128e80e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Image pref 0:0:0 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 14:35:45.659894 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.virt.hardware [None req-41cb407d-509e-4c72-8684-563a6128e80e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117780) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 14:35:45.668825 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-41cb407d-509e-4c72-8684-563a6128e80e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:45.669179 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-41cb407d-509e-4c72-8684-563a6128e80e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:45.669983 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-41cb407d-509e-4c72-8684-563a6128e80e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:45.670487 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-41cb407d-509e-4c72-8684-563a6128e80e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:45.687499 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-41cb407d-509e-4c72-8684-563a6128e80e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Getting quotas for project 8561e7f1f3d040e28d5084ebf937e198. Resources: {'cores', 'ram', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:35:45.691397 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.quota [None req-41cb407d-509e-4c72-8684-563a6128e80e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Getting quotas for user 0bbe35ad557841c581e3b1a4aa272f38 and project 8561e7f1f3d040e28d5084ebf937e198. Resources: {'cores', 'ram', 'instances'} {{(pid=117780) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:35:45.924508 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-41cb407d-509e-4c72-8684-563a6128e80e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Going to run 1 instances... {{(pid=117780) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 14:35:45.926582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-41cb407d-509e-4c72-8684-563a6128e80e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 13d860ea-649d-450e-9109-a894846adb15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1911e50c-387e-4807-8801-8516ee4443a6',volume_size=None,volume_type=None)] {{(pid=117780) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 14:35:45.960694 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=3 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:35:45.961428 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:35:45.965680 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-414cfd8f-ec88-4340-b8f1-29db7414e90f tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1290874795", "imageRef": "57bc051a-64d0-4317-aa93-a7a2aed39369", "flavorRef": "452", "networks": [{"uuid": "c85fbeb7-d3c2-47fa-ac7c-336d64a89822"}]}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:35:46.020707 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.network.neutron [None req-414cfd8f-ec88-4340-b8f1-29db7414e90f tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] validate_networks() for [('c85fbeb7-d3c2-47fa-ac7c-336d64a89822', None, None, None, None, None)] {{(pid=117781) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 14:35:46.061857 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-41cb407d-509e-4c72-8684-563a6128e80e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.888879 Jul 31 14:35:46.062785 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 523/1019] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Jul 31 14:35:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 14:35:46.074204 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-3e4910e4-a0f4-4d10-a529-53a24f127bc4 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:35:46.075234 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-3e4910e4-a0f4-4d10-a529-53a24f127bc4 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 13d860ea-649d-450e-9109-a894846adb15] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:35:46.137457 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-3e4910e4-a0f4-4d10-a529-53a24f127bc4 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:35:46.145546 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-3e4910e4-a0f4-4d10-a529-53a24f127bc4 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15" status: 200 len: 1095 microversion: 2.1 time: 0.075158 Jul 31 14:35:46.146727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 524/1020] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:35:46 2022] GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15 => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:35:46.439602 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-414cfd8f-ec88-4340-b8f1-29db7414e90f tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Flavor limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 14:35:46.440031 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-414cfd8f-ec88-4340-b8f1-29db7414e90f tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Image limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 14:35:46.440507 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-414cfd8f-ec88-4340-b8f1-29db7414e90f tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Flavor pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 14:35:46.440912 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-414cfd8f-ec88-4340-b8f1-29db7414e90f tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Image pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 14:35:46.441321 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-414cfd8f-ec88-4340-b8f1-29db7414e90f tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 14:35:46.450860 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-414cfd8f-ec88-4340-b8f1-29db7414e90f tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:46.451306 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-414cfd8f-ec88-4340-b8f1-29db7414e90f tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:46.452137 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-414cfd8f-ec88-4340-b8f1-29db7414e90f tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:46.452848 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-414cfd8f-ec88-4340-b8f1-29db7414e90f tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:46.469222 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-414cfd8f-ec88-4340-b8f1-29db7414e90f tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Getting quotas for project 641f0c2e10be46218a8cb78b8ca9b62c. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:35:46.473225 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-414cfd8f-ec88-4340-b8f1-29db7414e90f tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Getting quotas for user e0d7c887fc7b4987ad0bb94a5a99de5c and project 641f0c2e10be46218a8cb78b8ca9b62c. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:35:46.484786 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-414cfd8f-ec88-4340-b8f1-29db7414e90f tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Going to run 1 instances... {{(pid=117781) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 14:35:46.487036 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-414cfd8f-ec88-4340-b8f1-29db7414e90f tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: b0a7d90d-adba-472a-93b0-973f1648c46c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57bc051a-64d0-4317-aa93-a7a2aed39369',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117781) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 14:35:46.530726 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-414cfd8f-ec88-4340-b8f1-29db7414e90f tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571819 Jul 31 14:35:46.531486 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 497/1021] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Jul 31 14:35:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 31 14:35:46.543201 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b5cbefa4-d482-4c39-8931-d553fba898fc tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:35:46.543948 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b5cbefa4-d482-4c39-8931-d553fba898fc tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: b0a7d90d-adba-472a-93b0-973f1648c46c] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:35:46.597624 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b5cbefa4-d482-4c39-8931-d553fba898fc tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:35:46.604873 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b5cbefa4-d482-4c39-8931-d553fba898fc tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c" status: 200 len: 1219 microversion: 2.1 time: 0.066123 Jul 31 14:35:46.605442 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 525/1022] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:35:46 2022] GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:35:47.168844 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-043547ed-4092-4f6f-9983-e5d298242259 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:35:47.169461 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-043547ed-4092-4f6f-9983-e5d298242259 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 13d860ea-649d-450e-9109-a894846adb15] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:35:47.180141 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-043547ed-4092-4f6f-9983-e5d298242259 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:47.180571 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-043547ed-4092-4f6f-9983-e5d298242259 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:47.181581 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-043547ed-4092-4f6f-9983-e5d298242259 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:47.182032 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-043547ed-4092-4f6f-9983-e5d298242259 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:47.254227 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-043547ed-4092-4f6f-9983-e5d298242259 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:35:47.262385 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-043547ed-4092-4f6f-9983-e5d298242259 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15" status: 200 len: 1211 microversion: 2.1 time: 0.099961 Jul 31 14:35:47.262950 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 498/1023] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:35:47 2022] GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15 => generated 1211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:35:47.626582 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-525a475a-bd90-46af-ae20-3eca4f6e1600 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:35:47.627406 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-525a475a-bd90-46af-ae20-3eca4f6e1600 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: b0a7d90d-adba-472a-93b0-973f1648c46c] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:35:47.635885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-525a475a-bd90-46af-ae20-3eca4f6e1600 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:47.636332 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-525a475a-bd90-46af-ae20-3eca4f6e1600 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:47.637437 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-525a475a-bd90-46af-ae20-3eca4f6e1600 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:47.637863 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-525a475a-bd90-46af-ae20-3eca4f6e1600 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:47.724619 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-525a475a-bd90-46af-ae20-3eca4f6e1600 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:35:47.733062 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-525a475a-bd90-46af-ae20-3eca4f6e1600 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c" status: 200 len: 1279 microversion: 2.1 time: 0.110261 Jul 31 14:35:47.734016 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 526/1024] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:35:47 2022] GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c => generated 1279 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:35:48.284313 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-e7316428-8893-4418-b567-cd5c10efc9bc tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:35:48.284924 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-e7316428-8893-4418-b567-cd5c10efc9bc tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 13d860ea-649d-450e-9109-a894846adb15] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:35:48.292018 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e7316428-8893-4418-b567-cd5c10efc9bc tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:48.292464 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e7316428-8893-4418-b567-cd5c10efc9bc tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:48.293249 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e7316428-8893-4418-b567-cd5c10efc9bc tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:48.293674 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-e7316428-8893-4418-b567-cd5c10efc9bc tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:48.425780 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-e7316428-8893-4418-b567-cd5c10efc9bc tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:35:48.433176 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-e7316428-8893-4418-b567-cd5c10efc9bc tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15" status: 200 len: 1199 microversion: 2.1 time: 0.152866 Jul 31 14:35:48.433746 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 499/1025] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:35:48 2022] GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15 => generated 1199 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:35:48.756723 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-428d90fe-90d3-4224-9d1a-537309afa874 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:35:48.757787 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-428d90fe-90d3-4224-9d1a-537309afa874 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: b0a7d90d-adba-472a-93b0-973f1648c46c] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:35:48.764780 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-428d90fe-90d3-4224-9d1a-537309afa874 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:48.765548 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-428d90fe-90d3-4224-9d1a-537309afa874 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:48.766428 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-428d90fe-90d3-4224-9d1a-537309afa874 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:48.767099 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-428d90fe-90d3-4224-9d1a-537309afa874 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:48.835833 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-428d90fe-90d3-4224-9d1a-537309afa874 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:35:48.844079 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-428d90fe-90d3-4224-9d1a-537309afa874 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c" status: 200 len: 1277 microversion: 2.1 time: 0.091885 Jul 31 14:35:48.844741 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 527/1026] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:35:48 2022] GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:35:49.455810 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-9b7ec94f-87ac-448e-bdde-9e35cfec43aa tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:35:49.456436 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-9b7ec94f-87ac-448e-bdde-9e35cfec43aa tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 13d860ea-649d-450e-9109-a894846adb15] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:35:49.464039 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9b7ec94f-87ac-448e-bdde-9e35cfec43aa tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:49.464492 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9b7ec94f-87ac-448e-bdde-9e35cfec43aa tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:49.465379 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9b7ec94f-87ac-448e-bdde-9e35cfec43aa tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:49.465712 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9b7ec94f-87ac-448e-bdde-9e35cfec43aa tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:49.756871 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-9b7ec94f-87ac-448e-bdde-9e35cfec43aa tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:35:49.765059 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-9b7ec94f-87ac-448e-bdde-9e35cfec43aa tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15" status: 200 len: 1267 microversion: 2.1 time: 0.314878 Jul 31 14:35:49.765650 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 500/1027] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:35:49 2022] GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15 => generated 1267 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:35:49.865661 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-a9f26799-0659-407b-966b-d8ce0fc06320 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:35:49.866284 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-a9f26799-0659-407b-966b-d8ce0fc06320 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: b0a7d90d-adba-472a-93b0-973f1648c46c] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:35:49.873316 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a9f26799-0659-407b-966b-d8ce0fc06320 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:49.873769 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a9f26799-0659-407b-966b-d8ce0fc06320 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:49.874576 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a9f26799-0659-407b-966b-d8ce0fc06320 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:49.875258 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-a9f26799-0659-407b-966b-d8ce0fc06320 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:49.928274 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-2f6cbe3e-daca-429d-ac70-5fce3de99291 req-2f32e1c5-cd29-4942-bec7-f9ecef3722dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13d860ea-649d-450e-9109-a894846adb15", "tag": "95d89b44-b2c4-45a0-92d6-216979da73e6"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:35:49.941895 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-2f6cbe3e-daca-429d-ac70-5fce3de99291 req-2f32e1c5-cd29-4942-bec7-f9ecef3722dc service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:49.942674 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-2f6cbe3e-daca-429d-ac70-5fce3de99291 req-2f32e1c5-cd29-4942-bec7-f9ecef3722dc service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:49.956038 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-2f6cbe3e-daca-429d-ac70-5fce3de99291 req-2f32e1c5-cd29-4942-bec7-f9ecef3722dc service nova] Creating event network-changed:95d89b44-b2c4-45a0-92d6-216979da73e6 for instance 13d860ea-649d-450e-9109-a894846adb15 on hv-cinder-84984 Jul 31 14:35:49.969278 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-2f6cbe3e-daca-429d-ac70-5fce3de99291 req-2f32e1c5-cd29-4942-bec7-f9ecef3722dc service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045254 Jul 31 14:35:49.970317 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 501/1028] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:35:50.020999 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-a9f26799-0659-407b-966b-d8ce0fc06320 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:35:50.029351 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-a9f26799-0659-407b-966b-d8ce0fc06320 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c" status: 200 len: 1319 microversion: 2.1 time: 0.167648 Jul 31 14:35:50.029925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 528/1029] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:35:49 2022] GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:35:50.787257 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-044fde8e-fe83-4a68-8775-d76ba0ae98fd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:35:50.787977 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-044fde8e-fe83-4a68-8775-d76ba0ae98fd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 13d860ea-649d-450e-9109-a894846adb15] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:35:50.794728 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-044fde8e-fe83-4a68-8775-d76ba0ae98fd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:50.795175 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-044fde8e-fe83-4a68-8775-d76ba0ae98fd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:50.795970 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-044fde8e-fe83-4a68-8775-d76ba0ae98fd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:50.796406 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-044fde8e-fe83-4a68-8775-d76ba0ae98fd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:50.924931 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-044fde8e-fe83-4a68-8775-d76ba0ae98fd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:35:50.932338 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-044fde8e-fe83-4a68-8775-d76ba0ae98fd tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15" status: 200 len: 1267 microversion: 2.1 time: 0.149891 Jul 31 14:35:50.932900 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 502/1030] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:35:50 2022] GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:35:51.051465 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6bc8faa0-b98a-4be9-8466-c9aeaea77ec1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:35:51.052100 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6bc8faa0-b98a-4be9-8466-c9aeaea77ec1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: b0a7d90d-adba-472a-93b0-973f1648c46c] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:35:51.059038 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6bc8faa0-b98a-4be9-8466-c9aeaea77ec1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:51.059490 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6bc8faa0-b98a-4be9-8466-c9aeaea77ec1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:51.060284 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6bc8faa0-b98a-4be9-8466-c9aeaea77ec1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:51.060727 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6bc8faa0-b98a-4be9-8466-c9aeaea77ec1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:51.205658 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6bc8faa0-b98a-4be9-8466-c9aeaea77ec1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:35:51.214090 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6bc8faa0-b98a-4be9-8466-c9aeaea77ec1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c" status: 200 len: 1319 microversion: 2.1 time: 0.165877 Jul 31 14:35:51.214670 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 529/1031] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:35:51 2022] GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:35:51.953045 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-808ed49d-3c98-4bf1-a187-44e48518346c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:35:51.953662 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-808ed49d-3c98-4bf1-a187-44e48518346c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 13d860ea-649d-450e-9109-a894846adb15] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:35:51.960190 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-808ed49d-3c98-4bf1-a187-44e48518346c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:51.960643 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-808ed49d-3c98-4bf1-a187-44e48518346c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:51.961412 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-808ed49d-3c98-4bf1-a187-44e48518346c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:51.961848 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-808ed49d-3c98-4bf1-a187-44e48518346c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:51.996831 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-23ccaa04-70cf-47cc-8134-abbccb0a3284 req-ac0fdd7d-208d-4c3b-bf90-ff3a53dc8cac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0a7d90d-adba-472a-93b0-973f1648c46c", "tag": "30d825a8-70cd-4bbf-afeb-49cdc184b4fa"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:35:52.006242 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-23ccaa04-70cf-47cc-8134-abbccb0a3284 req-ac0fdd7d-208d-4c3b-bf90-ff3a53dc8cac service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:52.006688 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-23ccaa04-70cf-47cc-8134-abbccb0a3284 req-ac0fdd7d-208d-4c3b-bf90-ff3a53dc8cac service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:52.017664 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-23ccaa04-70cf-47cc-8134-abbccb0a3284 req-ac0fdd7d-208d-4c3b-bf90-ff3a53dc8cac service nova] Creating event network-changed:30d825a8-70cd-4bbf-afeb-49cdc184b4fa for instance b0a7d90d-adba-472a-93b0-973f1648c46c on hv-cinder-84984 Jul 31 14:35:52.022732 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-23ccaa04-70cf-47cc-8134-abbccb0a3284 req-ac0fdd7d-208d-4c3b-bf90-ff3a53dc8cac service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030263 Jul 31 14:35:52.023328 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 530/1032] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:35:52.094519 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-808ed49d-3c98-4bf1-a187-44e48518346c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:35:52.101972 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-808ed49d-3c98-4bf1-a187-44e48518346c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15" status: 200 len: 1267 microversion: 2.1 time: 0.153048 Jul 31 14:35:52.102531 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 503/1033] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:35:51 2022] GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:35:52.235904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b4c8442d-7052-4c48-84a8-9644b6303892 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:35:52.236607 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b4c8442d-7052-4c48-84a8-9644b6303892 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: b0a7d90d-adba-472a-93b0-973f1648c46c] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:35:52.242803 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b4c8442d-7052-4c48-84a8-9644b6303892 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:52.243254 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b4c8442d-7052-4c48-84a8-9644b6303892 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:52.244057 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b4c8442d-7052-4c48-84a8-9644b6303892 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:52.244496 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b4c8442d-7052-4c48-84a8-9644b6303892 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:52.373304 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b4c8442d-7052-4c48-84a8-9644b6303892 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:35:52.380904 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b4c8442d-7052-4c48-84a8-9644b6303892 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c" status: 200 len: 1319 microversion: 2.1 time: 0.149558 Jul 31 14:35:52.381492 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 531/1034] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:35:52 2022] GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:35:53.123321 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-917c95d9-1bf8-4812-a76e-02ef80e17696 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:35:53.124119 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-917c95d9-1bf8-4812-a76e-02ef80e17696 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 13d860ea-649d-450e-9109-a894846adb15] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:35:53.130593 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-917c95d9-1bf8-4812-a76e-02ef80e17696 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:53.131038 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-917c95d9-1bf8-4812-a76e-02ef80e17696 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:53.131851 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-917c95d9-1bf8-4812-a76e-02ef80e17696 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:53.132281 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-917c95d9-1bf8-4812-a76e-02ef80e17696 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:53.262140 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-917c95d9-1bf8-4812-a76e-02ef80e17696 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:35:53.269509 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-917c95d9-1bf8-4812-a76e-02ef80e17696 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15" status: 200 len: 1267 microversion: 2.1 time: 0.150517 Jul 31 14:35:53.270069 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 504/1035] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:35:53 2022] GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:35:53.401036 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-40c6283f-7f2f-44a6-a12d-ee37298e9fa4 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:35:53.401587 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-40c6283f-7f2f-44a6-a12d-ee37298e9fa4 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: b0a7d90d-adba-472a-93b0-973f1648c46c] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:35:53.408063 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-40c6283f-7f2f-44a6-a12d-ee37298e9fa4 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:53.408512 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-40c6283f-7f2f-44a6-a12d-ee37298e9fa4 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:53.409268 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-40c6283f-7f2f-44a6-a12d-ee37298e9fa4 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:53.409704 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-40c6283f-7f2f-44a6-a12d-ee37298e9fa4 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:53.538136 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-40c6283f-7f2f-44a6-a12d-ee37298e9fa4 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:35:53.546208 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-40c6283f-7f2f-44a6-a12d-ee37298e9fa4 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c" status: 200 len: 1319 microversion: 2.1 time: 0.149093 Jul 31 14:35:53.546786 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 532/1036] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:35:53 2022] GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:35:54.289899 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-90579557-15f6-483e-8586-af363e032bf5 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:35:54.290514 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-90579557-15f6-483e-8586-af363e032bf5 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 13d860ea-649d-450e-9109-a894846adb15] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:35:54.297151 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-90579557-15f6-483e-8586-af363e032bf5 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:54.297603 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-90579557-15f6-483e-8586-af363e032bf5 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:54.298371 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-90579557-15f6-483e-8586-af363e032bf5 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:54.298814 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-90579557-15f6-483e-8586-af363e032bf5 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:54.430400 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-90579557-15f6-483e-8586-af363e032bf5 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:35:54.438352 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-90579557-15f6-483e-8586-af363e032bf5 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15" status: 200 len: 1267 microversion: 2.1 time: 0.152429 Jul 31 14:35:54.438925 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 505/1037] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:35:54 2022] GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:35:54.567730 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9bdfb3da-28a9-4d10-9100-b1f6bed26c47 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:35:54.568344 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9bdfb3da-28a9-4d10-9100-b1f6bed26c47 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: b0a7d90d-adba-472a-93b0-973f1648c46c] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:35:54.575404 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9bdfb3da-28a9-4d10-9100-b1f6bed26c47 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:54.575880 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9bdfb3da-28a9-4d10-9100-b1f6bed26c47 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:54.576641 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9bdfb3da-28a9-4d10-9100-b1f6bed26c47 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:54.577083 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9bdfb3da-28a9-4d10-9100-b1f6bed26c47 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:54.706792 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9bdfb3da-28a9-4d10-9100-b1f6bed26c47 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:35:54.714172 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9bdfb3da-28a9-4d10-9100-b1f6bed26c47 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c" status: 200 len: 1319 microversion: 2.1 time: 0.150336 Jul 31 14:35:54.714737 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 533/1038] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:35:54 2022] GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:35:55.459661 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-1b46b6f4-6187-4f24-8533-e3db546f29e4 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:35:55.460211 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-1b46b6f4-6187-4f24-8533-e3db546f29e4 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 13d860ea-649d-450e-9109-a894846adb15] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:35:55.467176 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1b46b6f4-6187-4f24-8533-e3db546f29e4 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:55.467665 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1b46b6f4-6187-4f24-8533-e3db546f29e4 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:55.468429 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1b46b6f4-6187-4f24-8533-e3db546f29e4 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:55.468870 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-1b46b6f4-6187-4f24-8533-e3db546f29e4 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:55.598107 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-1b46b6f4-6187-4f24-8533-e3db546f29e4 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:35:55.605517 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-1b46b6f4-6187-4f24-8533-e3db546f29e4 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15" status: 200 len: 1267 microversion: 2.1 time: 0.149846 Jul 31 14:35:55.606086 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 506/1039] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:35:55 2022] GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:35:55.735985 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-4e440d13-958a-4571-b4ba-b836d2cccead tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:35:55.736601 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-4e440d13-958a-4571-b4ba-b836d2cccead tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: b0a7d90d-adba-472a-93b0-973f1648c46c] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:35:55.740523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:35:55.744236 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4e440d13-958a-4571-b4ba-b836d2cccead tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:55.744690 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4e440d13-958a-4571-b4ba-b836d2cccead tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:55.745480 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4e440d13-958a-4571-b4ba-b836d2cccead tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:55.745909 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-4e440d13-958a-4571-b4ba-b836d2cccead tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:55.879663 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-4e440d13-958a-4571-b4ba-b836d2cccead tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:35:55.888713 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-4e440d13-958a-4571-b4ba-b836d2cccead tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c" status: 200 len: 1319 microversion: 2.1 time: 0.156889 Jul 31 14:35:55.889422 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 534/1040] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:35:55 2022] GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:35:55.916132 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-0bc0d89d-cbf4-41d6-8c0a-9dad91275749 req-0692165e-e77a-432a-9fde-973d17461e06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a7d90d-adba-472a-93b0-973f1648c46c", "name": "network-vif-plugged", "status": "completed", "tag": "30d825a8-70cd-4bbf-afeb-49cdc184b4fa"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:35:55.925574 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-0bc0d89d-cbf4-41d6-8c0a-9dad91275749 req-0692165e-e77a-432a-9fde-973d17461e06 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:55.926022 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-0bc0d89d-cbf4-41d6-8c0a-9dad91275749 req-0692165e-e77a-432a-9fde-973d17461e06 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:55.937526 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-0bc0d89d-cbf4-41d6-8c0a-9dad91275749 req-0692165e-e77a-432a-9fde-973d17461e06 service nova] Creating event network-vif-plugged:30d825a8-70cd-4bbf-afeb-49cdc184b4fa for instance b0a7d90d-adba-472a-93b0-973f1648c46c on hv-cinder-84984 Jul 31 14:35:55.942568 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-0bc0d89d-cbf4-41d6-8c0a-9dad91275749 req-0692165e-e77a-432a-9fde-973d17461e06 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030150 Jul 31 14:35:55.943171 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 507/1041] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:35:56.626542 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6b07b59e-f4e8-48a1-a958-85ed87092c13 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:35:56.627152 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6b07b59e-f4e8-48a1-a958-85ed87092c13 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 13d860ea-649d-450e-9109-a894846adb15] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:35:56.629056 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=10 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:35:56.634451 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6b07b59e-f4e8-48a1-a958-85ed87092c13 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:56.634880 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6b07b59e-f4e8-48a1-a958-85ed87092c13 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:56.635664 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6b07b59e-f4e8-48a1-a958-85ed87092c13 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:56.636102 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6b07b59e-f4e8-48a1-a958-85ed87092c13 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:56.768336 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6b07b59e-f4e8-48a1-a958-85ed87092c13 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:35:56.776317 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6b07b59e-f4e8-48a1-a958-85ed87092c13 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15" status: 200 len: 1267 microversion: 2.1 time: 0.153012 Jul 31 14:35:56.776926 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 535/1042] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:35:56 2022] GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:35:56.907457 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:35:56.909349 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=6 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:35:56.914258 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-f9feb1bd-79c6-427a-91f7-c50e0c5aeea3 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:35:56.914994 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-f9feb1bd-79c6-427a-91f7-c50e0c5aeea3 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: b0a7d90d-adba-472a-93b0-973f1648c46c] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:35:56.923529 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f9feb1bd-79c6-427a-91f7-c50e0c5aeea3 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:56.923973 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f9feb1bd-79c6-427a-91f7-c50e0c5aeea3 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:56.924739 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f9feb1bd-79c6-427a-91f7-c50e0c5aeea3 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:56.925172 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-f9feb1bd-79c6-427a-91f7-c50e0c5aeea3 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:57.114094 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-f9feb1bd-79c6-427a-91f7-c50e0c5aeea3 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:35:57.121471 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-f9feb1bd-79c6-427a-91f7-c50e0c5aeea3 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c" status: 200 len: 1319 microversion: 2.1 time: 0.214999 Jul 31 14:35:57.122042 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 508/1043] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:35:56 2022] GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:35:57.797512 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9e33b6c3-a214-40b6-9b8a-737328181a6c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:35:57.798132 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9e33b6c3-a214-40b6-9b8a-737328181a6c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 13d860ea-649d-450e-9109-a894846adb15] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:35:57.805092 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9e33b6c3-a214-40b6-9b8a-737328181a6c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:57.805548 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9e33b6c3-a214-40b6-9b8a-737328181a6c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:57.806408 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9e33b6c3-a214-40b6-9b8a-737328181a6c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:57.807437 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9e33b6c3-a214-40b6-9b8a-737328181a6c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:57.944794 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9e33b6c3-a214-40b6-9b8a-737328181a6c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:35:57.952333 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9e33b6c3-a214-40b6-9b8a-737328181a6c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15" status: 200 len: 1267 microversion: 2.1 time: 0.158823 Jul 31 14:35:57.953160 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 536/1044] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:35:57 2022] GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:35:58.148999 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-6b3070f3-731a-44d5-9530-fcc86f605cf8 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:35:58.149619 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-6b3070f3-731a-44d5-9530-fcc86f605cf8 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: b0a7d90d-adba-472a-93b0-973f1648c46c] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:35:58.159352 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6b3070f3-731a-44d5-9530-fcc86f605cf8 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:58.159906 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6b3070f3-731a-44d5-9530-fcc86f605cf8 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:58.160682 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6b3070f3-731a-44d5-9530-fcc86f605cf8 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:58.161123 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6b3070f3-731a-44d5-9530-fcc86f605cf8 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:58.305469 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-6b3070f3-731a-44d5-9530-fcc86f605cf8 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:35:58.313017 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-6b3070f3-731a-44d5-9530-fcc86f605cf8 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c" status: 200 len: 1508 microversion: 2.1 time: 0.168024 Jul 31 14:35:58.313590 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 509/1045] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:35:58 2022] GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:35:58.972962 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-e94e21e4-200c-4037-a0a6-e28d0b1b748c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:35:58.973592 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-e94e21e4-200c-4037-a0a6-e28d0b1b748c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 13d860ea-649d-450e-9109-a894846adb15] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:35:58.981663 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e94e21e4-200c-4037-a0a6-e28d0b1b748c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:58.982120 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e94e21e4-200c-4037-a0a6-e28d0b1b748c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:58.982914 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e94e21e4-200c-4037-a0a6-e28d0b1b748c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:58.983357 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-e94e21e4-200c-4037-a0a6-e28d0b1b748c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:59.113717 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-e94e21e4-200c-4037-a0a6-e28d0b1b748c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:35:59.121307 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-e94e21e4-200c-4037-a0a6-e28d0b1b748c tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15" status: 200 len: 1267 microversion: 2.1 time: 0.152173 Jul 31 14:35:59.121878 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 537/1046] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:35:58 2022] GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:35:59.812868 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-9e780e12-3c22-432f-a690-9082c3f39a15 req-0d093961-0614-4da5-9c05-423fb5ce2ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13d860ea-649d-450e-9109-a894846adb15", "name": "network-vif-plugged", "status": "completed", "tag": "95d89b44-b2c4-45a0-92d6-216979da73e6"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:35:59.823783 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-9e780e12-3c22-432f-a690-9082c3f39a15 req-0d093961-0614-4da5-9c05-423fb5ce2ebf service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:35:59.824188 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-9e780e12-3c22-432f-a690-9082c3f39a15 req-0d093961-0614-4da5-9c05-423fb5ce2ebf service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:35:59.836972 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-9e780e12-3c22-432f-a690-9082c3f39a15 req-0d093961-0614-4da5-9c05-423fb5ce2ebf service nova] Creating event network-vif-plugged:95d89b44-b2c4-45a0-92d6-216979da73e6 for instance 13d860ea-649d-450e-9109-a894846adb15 on hv-cinder-84984 Jul 31 14:35:59.842863 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-9e780e12-3c22-432f-a690-9082c3f39a15 req-0d093961-0614-4da5-9c05-423fb5ce2ebf service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033614 Jul 31 14:35:59.843814 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 510/1047] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:36:00.142482 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-0845d763-9552-4866-9e3e-a79788783096 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:36:00.143833 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-0845d763-9552-4866-9e3e-a79788783096 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 13d860ea-649d-450e-9109-a894846adb15] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:36:00.150878 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0845d763-9552-4866-9e3e-a79788783096 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:00.151146 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0845d763-9552-4866-9e3e-a79788783096 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:00.152138 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0845d763-9552-4866-9e3e-a79788783096 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:00.152660 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-0845d763-9552-4866-9e3e-a79788783096 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:00.302402 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-0845d763-9552-4866-9e3e-a79788783096 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:36:00.310537 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-0845d763-9552-4866-9e3e-a79788783096 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15" status: 200 len: 1267 microversion: 2.1 time: 0.172416 Jul 31 14:36:00.311107 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 538/1048] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:36:00 2022] GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:36:01.333204 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-9bda9355-76b8-4a75-990a-cde40c267147 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:36:01.333906 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-9bda9355-76b8-4a75-990a-cde40c267147 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 13d860ea-649d-450e-9109-a894846adb15] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:36:01.340247 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9bda9355-76b8-4a75-990a-cde40c267147 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:01.340700 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9bda9355-76b8-4a75-990a-cde40c267147 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:01.341462 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9bda9355-76b8-4a75-990a-cde40c267147 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:01.341935 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-9bda9355-76b8-4a75-990a-cde40c267147 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:01.486400 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-9bda9355-76b8-4a75-990a-cde40c267147 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:36:01.494053 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-9bda9355-76b8-4a75-990a-cde40c267147 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15" status: 200 len: 1267 microversion: 2.1 time: 0.166026 Jul 31 14:36:01.495165 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 511/1049] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:36:01 2022] GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:36:02.515824 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-95eb37f4-cf49-46de-94cc-0bb02252bfff tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:36:02.516381 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-95eb37f4-cf49-46de-94cc-0bb02252bfff tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 13d860ea-649d-450e-9109-a894846adb15] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:36:02.522801 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-95eb37f4-cf49-46de-94cc-0bb02252bfff tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:02.523252 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-95eb37f4-cf49-46de-94cc-0bb02252bfff tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:02.524062 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-95eb37f4-cf49-46de-94cc-0bb02252bfff tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:02.524497 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-95eb37f4-cf49-46de-94cc-0bb02252bfff tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:02.664564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-95eb37f4-cf49-46de-94cc-0bb02252bfff tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:36:02.674459 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-95eb37f4-cf49-46de-94cc-0bb02252bfff tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15" status: 200 len: 1455 microversion: 2.1 time: 0.162576 Jul 31 14:36:02.675043 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 539/1050] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:36:02 2022] GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15 => generated 1455 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:36:02.697557 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-67a21b0e-77ae-4ec4-a10d-6e8209b0833a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:36:02.698831 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-67a21b0e-77ae-4ec4-a10d-6e8209b0833a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 13d860ea-649d-450e-9109-a894846adb15] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:36:02.706626 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-67a21b0e-77ae-4ec4-a10d-6e8209b0833a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:02.707078 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-67a21b0e-77ae-4ec4-a10d-6e8209b0833a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:02.707871 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-67a21b0e-77ae-4ec4-a10d-6e8209b0833a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:02.708316 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-67a21b0e-77ae-4ec4-a10d-6e8209b0833a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:02.837978 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-67a21b0e-77ae-4ec4-a10d-6e8209b0833a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:36:02.845984 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-67a21b0e-77ae-4ec4-a10d-6e8209b0833a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15" status: 200 len: 1455 microversion: 2.1 time: 0.152273 Jul 31 14:36:02.846567 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 512/1051] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:36:02 2022] GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15 => generated 1455 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:36:04.849888 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-8a72521b-0281-45c6-bd5b-6f058b3a9435 req-d3ffcdcc-389d-4ca7-9e71-886f639974ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13d860ea-649d-450e-9109-a894846adb15", "tag": "95d89b44-b2c4-45a0-92d6-216979da73e6"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:36:04.860543 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-8a72521b-0281-45c6-bd5b-6f058b3a9435 req-d3ffcdcc-389d-4ca7-9e71-886f639974ed service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:04.860993 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-8a72521b-0281-45c6-bd5b-6f058b3a9435 req-d3ffcdcc-389d-4ca7-9e71-886f639974ed service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:04.872148 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-8a72521b-0281-45c6-bd5b-6f058b3a9435 req-d3ffcdcc-389d-4ca7-9e71-886f639974ed service nova] Creating event network-changed:95d89b44-b2c4-45a0-92d6-216979da73e6 for instance 13d860ea-649d-450e-9109-a894846adb15 on hv-cinder-84984 Jul 31 14:36:04.877100 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-8a72521b-0281-45c6-bd5b-6f058b3a9435 req-d3ffcdcc-389d-4ca7-9e71-886f639974ed service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154756 Jul 31 14:36:04.877692 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 540/1052] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:36:08.331837 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 14:36:08.332462 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Sun Jul 31 14:36:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 14:36:13.531127 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-63899562-1a0b-4880-90c3-8ae8c2fd9a37 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93e2dc35-8a24-48cd-92a3-e7db9f8a3ae6", "device": "/dev/sdb"}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:36:13.533967 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-63899562-1a0b-4880-90c3-8ae8c2fd9a37 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: b0a7d90d-adba-472a-93b0-973f1648c46c] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:36:13.536298 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:36:13.536940 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=80 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:36:13.542592 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-63899562-1a0b-4880-90c3-8ae8c2fd9a37 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:13.543032 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-63899562-1a0b-4880-90c3-8ae8c2fd9a37 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:13.543926 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-63899562-1a0b-4880-90c3-8ae8c2fd9a37 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:13.544359 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-63899562-1a0b-4880-90c3-8ae8c2fd9a37 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:13.814968 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-63899562-1a0b-4880-90c3-8ae8c2fd9a37 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "POST /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287932 Jul 31 14:36:13.815618 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 513/1053] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Jul 31 14:36:13 2022] POST /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:36:36.504001 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:36:36.504731 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=84 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:36:36.508898 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-d3fa786d-d268-48c8-b8a1-31f738b81040 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:36:36.509478 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-d3fa786d-d268-48c8-b8a1-31f738b81040 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: b0a7d90d-adba-472a-93b0-973f1648c46c] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:36:36.516847 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d3fa786d-d268-48c8-b8a1-31f738b81040 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:36.517289 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d3fa786d-d268-48c8-b8a1-31f738b81040 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:36.518048 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d3fa786d-d268-48c8-b8a1-31f738b81040 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:36.518494 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-d3fa786d-d268-48c8-b8a1-31f738b81040 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:36.599852 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-d3fa786d-d268-48c8-b8a1-31f738b81040 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lazy-loading 'services' on Instance uuid b0a7d90d-adba-472a-93b0-973f1648c46c {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:36:36.670598 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-d3fa786d-d268-48c8-b8a1-31f738b81040 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c/os-volume_attachments/93e2dc35-8a24-48cd-92a3-e7db9f8a3ae6" status: 202 len: 0 microversion: 2.1 time: 0.167910 Jul 31 14:36:36.671384 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 541/1054] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Jul 31 14:36:36 2022] DELETE /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c/os-volume_attachments/93e2dc35-8a24-48cd-92a3-e7db9f8a3ae6 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:36:37.794870 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-c452a702-2b9e-408d-8555-5d445a2a5055 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:36:37.795474 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-c452a702-2b9e-408d-8555-5d445a2a5055 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: b0a7d90d-adba-472a-93b0-973f1648c46c] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:36:37.798589 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:36:37.799245 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:36:37.805297 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c452a702-2b9e-408d-8555-5d445a2a5055 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:37.805746 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c452a702-2b9e-408d-8555-5d445a2a5055 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:37.806509 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c452a702-2b9e-408d-8555-5d445a2a5055 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:37.806942 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c452a702-2b9e-408d-8555-5d445a2a5055 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:37.832265 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-c452a702-2b9e-408d-8555-5d445a2a5055 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: b0a7d90d-adba-472a-93b0-973f1648c46c] Going to try to terminate instance {{(pid=117781) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 14:36:37.910553 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-c452a702-2b9e-408d-8555-5d445a2a5055 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "DELETE /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c" status: 204 len: 0 microversion: 2.1 time: 0.119647 Jul 31 14:36:37.911173 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 514/1055] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:36:37 2022] DELETE /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 14:36:37.920588 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2609f839-14e1-4ca0-b77c-2e9a82cd8f4d tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:36:37.921281 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2609f839-14e1-4ca0-b77c-2e9a82cd8f4d tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: b0a7d90d-adba-472a-93b0-973f1648c46c] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:36:37.928105 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2609f839-14e1-4ca0-b77c-2e9a82cd8f4d tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:37.928549 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2609f839-14e1-4ca0-b77c-2e9a82cd8f4d tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:37.929309 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2609f839-14e1-4ca0-b77c-2e9a82cd8f4d tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:37.929743 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2609f839-14e1-4ca0-b77c-2e9a82cd8f4d tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:38.070313 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2609f839-14e1-4ca0-b77c-2e9a82cd8f4d tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:36:38.077922 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2609f839-14e1-4ca0-b77c-2e9a82cd8f4d tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c" status: 200 len: 1514 microversion: 2.1 time: 0.161977 Jul 31 14:36:38.079241 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 542/1056] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:36:37 2022] GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:36:39.101238 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-30ebfd15-b67c-4467-906a-6cafb9993a66 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:36:39.102032 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-30ebfd15-b67c-4467-906a-6cafb9993a66 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: b0a7d90d-adba-472a-93b0-973f1648c46c] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:36:39.108598 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-30ebfd15-b67c-4467-906a-6cafb9993a66 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:39.109059 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-30ebfd15-b67c-4467-906a-6cafb9993a66 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:39.109879 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-30ebfd15-b67c-4467-906a-6cafb9993a66 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:39.110588 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-30ebfd15-b67c-4467-906a-6cafb9993a66 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:39.241253 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-30ebfd15-b67c-4467-906a-6cafb9993a66 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:36:39.248719 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-30ebfd15-b67c-4467-906a-6cafb9993a66 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c" status: 200 len: 1514 microversion: 2.1 time: 0.151928 Jul 31 14:36:39.249284 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 515/1057] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:36:39 2022] GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:36:40.032224 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-11876ef0-185c-4588-a4f6-a72869c1f0b1 req-5d81f4e6-a36e-4fb0-989b-259834db4eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a7d90d-adba-472a-93b0-973f1648c46c", "name": "network-vif-deleted", "tag": "30d825a8-70cd-4bbf-afeb-49cdc184b4fa"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:36:40.041763 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-11876ef0-185c-4588-a4f6-a72869c1f0b1 req-5d81f4e6-a36e-4fb0-989b-259834db4eff service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:40.042201 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-11876ef0-185c-4588-a4f6-a72869c1f0b1 req-5d81f4e6-a36e-4fb0-989b-259834db4eff service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:40.054071 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-11876ef0-185c-4588-a4f6-a72869c1f0b1 req-5d81f4e6-a36e-4fb0-989b-259834db4eff service nova] Creating event network-vif-deleted:30d825a8-70cd-4bbf-afeb-49cdc184b4fa for instance b0a7d90d-adba-472a-93b0-973f1648c46c on hv-cinder-84984 Jul 31 14:36:40.059023 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-11876ef0-185c-4588-a4f6-a72869c1f0b1 req-5d81f4e6-a36e-4fb0-989b-259834db4eff service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031438 Jul 31 14:36:40.059657 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 543/1058] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:36:40.270044 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-2bfab354-fb7f-4574-b843-ae18a0db9e32 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:36:40.271303 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-2bfab354-fb7f-4574-b843-ae18a0db9e32 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: b0a7d90d-adba-472a-93b0-973f1648c46c] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:36:40.277637 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2bfab354-fb7f-4574-b843-ae18a0db9e32 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:40.278083 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2bfab354-fb7f-4574-b843-ae18a0db9e32 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:40.278868 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2bfab354-fb7f-4574-b843-ae18a0db9e32 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:40.279298 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2bfab354-fb7f-4574-b843-ae18a0db9e32 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:40.311689 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2bfab354-fb7f-4574-b843-ae18a0db9e32 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:40.312153 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-2bfab354-fb7f-4574-b843-ae18a0db9e32 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:40.312671 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.objects.instance [None req-2bfab354-fb7f-4574-b843-ae18a0db9e32 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lazy-loading 'fault' on Instance uuid b0a7d90d-adba-472a-93b0-973f1648c46c {{(pid=117781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:36:40.358919 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-2bfab354-fb7f-4574-b843-ae18a0db9e32 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:36:40.366389 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-2bfab354-fb7f-4574-b843-ae18a0db9e32 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c" status: 200 len: 1309 microversion: 2.1 time: 0.100203 Jul 31 14:36:40.366956 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 516/1059] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:36:40 2022] GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:36:41.388297 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b2c2f7a7-ade7-44eb-9375-5c41f795184c tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:36:41.389022 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b2c2f7a7-ade7-44eb-9375-5c41f795184c tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: b0a7d90d-adba-472a-93b0-973f1648c46c] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:36:41.395231 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b2c2f7a7-ade7-44eb-9375-5c41f795184c tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:41.395658 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b2c2f7a7-ade7-44eb-9375-5c41f795184c tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:41.396415 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b2c2f7a7-ade7-44eb-9375-5c41f795184c tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:41.396850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b2c2f7a7-ade7-44eb-9375-5c41f795184c tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:41.410229 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-b2c2f7a7-ade7-44eb-9375-5c41f795184c tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] HTTP exception thrown: Instance b0a7d90d-adba-472a-93b0-973f1648c46c could not be found. Jul 31 14:36:41.411850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b2c2f7a7-ade7-44eb-9375-5c41f795184c tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Request method failure captured: Jul 31 14:36:41.411850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c HTTP/1.1 Jul 31 14:36:41.411850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:36:41.411850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:36:41.411850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:36:41.411850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:36:41.411850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:36:41.411850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:36:41.411850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:36:41.411850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:36:41.411850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pNAwLwMO4MtQvf8jcA493s0OeivdZ88df9sbGcFhiV9VYsYdJ2ZxidB-q7TZPg8JZ1uNrgdF5yvrlp9I-FXgEqUJJIvf5EOUCWdBzJN5zua7AQNeZeSed9I7UOGVwN_Fum-k-RIW_TGNpaRNQA7Dvlxnw_me6NOrKKcKNHxWRWHhYc Jul 31 14:36:41.411850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:36:41.411850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:36:41.411850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:36:41.411850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:36:41.411850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:36:41.411850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:36:41.411850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: 641f0c2e10be46218a8cb78b8ca9b62c Jul 31 14:36:41.411850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1387793288 Jul 31 14:36:41.411850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:36:41.411850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:36:41.413546 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/641f0c2e10be46218a8cb78b8ca9b62c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_641f0c2e10be46218a8cb78b8ca9b62c", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/641f0c2e10be46218a8cb78b8ca9b62c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/641f0c2e10be46218a8cb78b8ca9b62c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:36:41.413546 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-VolumesSnapshotTestJSON-1387793288 Jul 31 14:36:41.413546 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 641f0c2e10be46218a8cb78b8ca9b62c Jul 31 14:36:41.413546 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1387793288 Jul 31 14:36:41.413546 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-VolumesSnapshotTestJSON-1387793288-project Jul 31 14:36:41.413546 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:36:41.413546 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:36:41.413546 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: e0d7c887fc7b4987ad0bb94a5a99de5c Jul 31 14:36:41.413546 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-VolumesSnapshotTestJSON-1387793288-project Jul 31 14:36:41.413546 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:36:41.413546 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance b0a7d90d-adba-472a-93b0-973f1648c46c could not be found. Jul 31 14:36:41.413546 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': 'b0a7d90d-adba-472a-93b0-973f1648c46c'} Jul 31 14:36:41.414564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:36:41.414564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:36:41.414564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:36:41.414564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:36:41.414564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:36:41.414564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:36:41.414564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:36:41.414564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:36:41.414564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:36:41.414564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:36:41.414564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a7d90d-adba-472a-93b0-973f1648c46c could not be found. Jul 31 14:36:41.414564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:36:41.414564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:36:41.414564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:36:41.414564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:36:41.414564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:36:41.414564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:36:41.414564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:36:41.414564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:36:41.414564 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:36:41.417218 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:36:41.417218 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:36:41.417218 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:36:41.417218 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:36:41.417218 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:36:41.417218 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:36:41.417218 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:36:41.417218 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a7d90d-adba-472a-93b0-973f1648c46c could not be found. Jul 31 14:36:41.417218 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:36:41.417218 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:36:41.417218 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:36:41.417218 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:36:41.417218 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:36:41.417218 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:36:41.417218 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:36:41.417218 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:36:41.417218 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a7d90d-adba-472a-93b0-973f1648c46c could not be found. Jul 31 14:36:41.417218 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:36:41.418714 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b2c2f7a7-ade7-44eb-9375-5c41f795184c tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Returning 404 to user: Instance b0a7d90d-adba-472a-93b0-973f1648c46c could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:36:41.418714 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b2c2f7a7-ade7-44eb-9375-5c41f795184c tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c" status: 404 len: 111 microversion: 2.1 time: 0.029771 Jul 31 14:36:41.418714 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 544/1060] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:36:41 2022] GET /compute/v2.1/servers/b0a7d90d-adba-472a-93b0-973f1648c46c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:36:49.192730 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-6d8d21b5-e6ad-4f78-a374-afa5a4241f10 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-832605790", "imageRef": "57bc051a-64d0-4317-aa93-a7a2aed39369", "flavorRef": "452", "networks": [{"uuid": "c85fbeb7-d3c2-47fa-ac7c-336d64a89822"}]}} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:36:49.244533 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.network.neutron [None req-6d8d21b5-e6ad-4f78-a374-afa5a4241f10 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] validate_networks() for [('c85fbeb7-d3c2-47fa-ac7c-336d64a89822', None, None, None, None, None)] {{(pid=117781) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 31 14:36:49.580025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-6d8d21b5-e6ad-4f78-a374-afa5a4241f10 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Flavor limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 31 14:36:49.580945 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-6d8d21b5-e6ad-4f78-a374-afa5a4241f10 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Image limits 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 31 14:36:49.581411 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-6d8d21b5-e6ad-4f78-a374-afa5a4241f10 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Flavor pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 31 14:36:49.581811 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-6d8d21b5-e6ad-4f78-a374-afa5a4241f10 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Image pref 0:0:0 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 31 14:36:49.582213 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.virt.hardware [None req-6d8d21b5-e6ad-4f78-a374-afa5a4241f10 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117781) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 31 14:36:49.590899 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6d8d21b5-e6ad-4f78-a374-afa5a4241f10 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:49.591339 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6d8d21b5-e6ad-4f78-a374-afa5a4241f10 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:49.592154 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6d8d21b5-e6ad-4f78-a374-afa5a4241f10 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:49.592586 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6d8d21b5-e6ad-4f78-a374-afa5a4241f10 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:49.609133 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-6d8d21b5-e6ad-4f78-a374-afa5a4241f10 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Getting quotas for project 641f0c2e10be46218a8cb78b8ca9b62c. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 31 14:36:49.613028 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.quota [None req-6d8d21b5-e6ad-4f78-a374-afa5a4241f10 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Getting quotas for user e0d7c887fc7b4987ad0bb94a5a99de5c and project 641f0c2e10be46218a8cb78b8ca9b62c. Resources: {'cores', 'ram', 'instances'} {{(pid=117781) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 31 14:36:49.623541 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-6d8d21b5-e6ad-4f78-a374-afa5a4241f10 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Going to run 1 instances... {{(pid=117781) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 31 14:36:49.625702 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-6d8d21b5-e6ad-4f78-a374-afa5a4241f10 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: ad3cfed9-01ad-4da4-9459-d1c9141129d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57bc051a-64d0-4317-aa93-a7a2aed39369',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117781) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 31 14:36:49.669502 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-6d8d21b5-e6ad-4f78-a374-afa5a4241f10 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.480713 Jul 31 14:36:49.670072 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 517/1061] 10.222.0.40 () {60 vars in 1147 bytes} [Sun Jul 31 14:36:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 31 14:36:49.681062 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-8ba94068-1ab5-44b0-b365-f16c11a22dd0 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:36:49.681667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-8ba94068-1ab5-44b0-b365-f16c11a22dd0 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: ad3cfed9-01ad-4da4-9459-d1c9141129d6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:36:49.734862 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-8ba94068-1ab5-44b0-b365-f16c11a22dd0 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:36:49.742143 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-8ba94068-1ab5-44b0-b365-f16c11a22dd0 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6" status: 200 len: 1218 microversion: 2.1 time: 0.064390 Jul 31 14:36:49.742349 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 545/1062] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:36:49 2022] GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:36:50.763240 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-a20e56a1-80f3-4572-8d25-ce2d0c019030 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:36:50.763875 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-a20e56a1-80f3-4572-8d25-ce2d0c019030 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: ad3cfed9-01ad-4da4-9459-d1c9141129d6] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:36:50.771324 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a20e56a1-80f3-4572-8d25-ce2d0c019030 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:50.771800 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a20e56a1-80f3-4572-8d25-ce2d0c019030 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:50.772553 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a20e56a1-80f3-4572-8d25-ce2d0c019030 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:50.772983 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-a20e56a1-80f3-4572-8d25-ce2d0c019030 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:50.866551 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-a20e56a1-80f3-4572-8d25-ce2d0c019030 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:36:50.874339 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-a20e56a1-80f3-4572-8d25-ce2d0c019030 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6" status: 200 len: 1276 microversion: 2.1 time: 0.115483 Jul 31 14:36:50.874921 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 518/1063] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:36:50 2022] GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6 => generated 1276 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:36:51.896598 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-6b0a1fca-113f-4f1e-91be-e0c305af64d1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:36:51.897491 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-6b0a1fca-113f-4f1e-91be-e0c305af64d1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: ad3cfed9-01ad-4da4-9459-d1c9141129d6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:36:51.900246 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:36:51.906668 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6b0a1fca-113f-4f1e-91be-e0c305af64d1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:51.907196 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6b0a1fca-113f-4f1e-91be-e0c305af64d1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:51.908081 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6b0a1fca-113f-4f1e-91be-e0c305af64d1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:51.908570 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-6b0a1fca-113f-4f1e-91be-e0c305af64d1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:52.038623 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-6b0a1fca-113f-4f1e-91be-e0c305af64d1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:36:52.046028 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-6b0a1fca-113f-4f1e-91be-e0c305af64d1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6" status: 200 len: 1318 microversion: 2.1 time: 0.154070 Jul 31 14:36:52.046596 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 546/1064] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:36:51 2022] GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:36:52.202607 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-69617ecd-1bac-415c-9e8e-bed1390952b9 req-45334075-fc80-47d3-9992-043de801996a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad3cfed9-01ad-4da4-9459-d1c9141129d6", "tag": "a764a1ca-cb58-4ec8-b2c3-0b13cedacdfd"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:36:52.214764 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-69617ecd-1bac-415c-9e8e-bed1390952b9 req-45334075-fc80-47d3-9992-043de801996a service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:52.215513 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-69617ecd-1bac-415c-9e8e-bed1390952b9 req-45334075-fc80-47d3-9992-043de801996a service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:52.227982 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-69617ecd-1bac-415c-9e8e-bed1390952b9 req-45334075-fc80-47d3-9992-043de801996a service nova] Creating event network-changed:a764a1ca-cb58-4ec8-b2c3-0b13cedacdfd for instance ad3cfed9-01ad-4da4-9459-d1c9141129d6 on hv-cinder-84984 Jul 31 14:36:52.232809 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-69617ecd-1bac-415c-9e8e-bed1390952b9 req-45334075-fc80-47d3-9992-043de801996a service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033984 Jul 31 14:36:52.233418 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 519/1065] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:36:53.068210 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-56aa5d9f-b025-49fd-8add-5e396d6b63d3 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:36:53.068811 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-56aa5d9f-b025-49fd-8add-5e396d6b63d3 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: ad3cfed9-01ad-4da4-9459-d1c9141129d6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:36:53.075191 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-56aa5d9f-b025-49fd-8add-5e396d6b63d3 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:53.075662 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-56aa5d9f-b025-49fd-8add-5e396d6b63d3 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:53.076417 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-56aa5d9f-b025-49fd-8add-5e396d6b63d3 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:53.076850 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-56aa5d9f-b025-49fd-8add-5e396d6b63d3 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:53.207238 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-56aa5d9f-b025-49fd-8add-5e396d6b63d3 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:36:53.214496 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-56aa5d9f-b025-49fd-8add-5e396d6b63d3 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6" status: 200 len: 1318 microversion: 2.1 time: 0.150864 Jul 31 14:36:53.215056 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 547/1066] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:36:53 2022] GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:36:54.236108 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-ec84c395-3697-4190-ab85-33d8738d83f7 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:36:54.236924 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-ec84c395-3697-4190-ab85-33d8738d83f7 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: ad3cfed9-01ad-4da4-9459-d1c9141129d6] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:36:54.243230 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ec84c395-3697-4190-ab85-33d8738d83f7 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:54.243710 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ec84c395-3697-4190-ab85-33d8738d83f7 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:54.244474 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ec84c395-3697-4190-ab85-33d8738d83f7 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:54.244913 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-ec84c395-3697-4190-ab85-33d8738d83f7 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:54.371690 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-ec84c395-3697-4190-ab85-33d8738d83f7 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:36:54.379578 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-ec84c395-3697-4190-ab85-33d8738d83f7 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6" status: 200 len: 1318 microversion: 2.1 time: 0.148196 Jul 31 14:36:54.380156 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 520/1067] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:36:54 2022] GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:36:55.403178 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-1179a617-44f7-452d-a98d-ce130c7205bd tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:36:55.403178 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-1179a617-44f7-452d-a98d-ce130c7205bd tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: ad3cfed9-01ad-4da4-9459-d1c9141129d6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:36:55.411140 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1179a617-44f7-452d-a98d-ce130c7205bd tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:55.411735 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1179a617-44f7-452d-a98d-ce130c7205bd tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:55.412497 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1179a617-44f7-452d-a98d-ce130c7205bd tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:55.412930 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-1179a617-44f7-452d-a98d-ce130c7205bd tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:55.538185 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-1179a617-44f7-452d-a98d-ce130c7205bd tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:36:55.545510 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-1179a617-44f7-452d-a98d-ce130c7205bd tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6" status: 200 len: 1318 microversion: 2.1 time: 0.147387 Jul 31 14:36:55.546071 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 548/1068] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:36:55 2022] GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:36:56.566823 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-d0c9ad2b-e401-481d-b981-40ff16c6b2fe tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:36:56.567587 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-d0c9ad2b-e401-481d-b981-40ff16c6b2fe tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: ad3cfed9-01ad-4da4-9459-d1c9141129d6] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:36:56.574038 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d0c9ad2b-e401-481d-b981-40ff16c6b2fe tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:56.574490 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d0c9ad2b-e401-481d-b981-40ff16c6b2fe tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:56.575253 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d0c9ad2b-e401-481d-b981-40ff16c6b2fe tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:56.575712 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-d0c9ad2b-e401-481d-b981-40ff16c6b2fe tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:56.624957 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [req-6331f814-df8b-4262-babb-1cecc2cd9804 req-eb1101a3-ed03-4ab7-9b32-cc39a67c4d67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3cfed9-01ad-4da4-9459-d1c9141129d6", "name": "network-vif-plugged", "status": "completed", "tag": "a764a1ca-cb58-4ec8-b2c3-0b13cedacdfd"}]} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:36:56.641790 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-6331f814-df8b-4262-babb-1cecc2cd9804 req-eb1101a3-ed03-4ab7-9b32-cc39a67c4d67 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:56.642380 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [req-6331f814-df8b-4262-babb-1cecc2cd9804 req-eb1101a3-ed03-4ab7-9b32-cc39a67c4d67 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:56.654568 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.compute.server_external_events [req-6331f814-df8b-4262-babb-1cecc2cd9804 req-eb1101a3-ed03-4ab7-9b32-cc39a67c4d67 service nova] Creating event network-vif-plugged:a764a1ca-cb58-4ec8-b2c3-0b13cedacdfd for instance ad3cfed9-01ad-4da4-9459-d1c9141129d6 on hv-cinder-84984 Jul 31 14:36:56.659673 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [req-6331f814-df8b-4262-babb-1cecc2cd9804 req-eb1101a3-ed03-4ab7-9b32-cc39a67c4d67 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038399 Jul 31 14:36:56.660533 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 549/1069] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 31 14:36:56.725827 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-d0c9ad2b-e401-481d-b981-40ff16c6b2fe tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:36:56.733471 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-d0c9ad2b-e401-481d-b981-40ff16c6b2fe tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6" status: 200 len: 1318 microversion: 2.1 time: 0.170979 Jul 31 14:36:56.734042 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 521/1070] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:36:56 2022] GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:36:57.755094 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-63fd7a31-0614-4896-a14c-9de430d44589 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:36:57.755804 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-63fd7a31-0614-4896-a14c-9de430d44589 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: ad3cfed9-01ad-4da4-9459-d1c9141129d6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:36:57.761927 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-63fd7a31-0614-4896-a14c-9de430d44589 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:57.762368 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-63fd7a31-0614-4896-a14c-9de430d44589 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:57.763117 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-63fd7a31-0614-4896-a14c-9de430d44589 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:57.763587 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-63fd7a31-0614-4896-a14c-9de430d44589 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:57.895967 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-63fd7a31-0614-4896-a14c-9de430d44589 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:36:57.903250 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-63fd7a31-0614-4896-a14c-9de430d44589 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6" status: 200 len: 1318 microversion: 2.1 time: 0.152876 Jul 31 14:36:57.903872 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 550/1071] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:36:57 2022] GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:36:58.924632 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-66a2c857-746a-4cde-8fb3-7185ace543be tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:36:58.925245 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-66a2c857-746a-4cde-8fb3-7185ace543be tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: ad3cfed9-01ad-4da4-9459-d1c9141129d6] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:36:58.931804 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-66a2c857-746a-4cde-8fb3-7185ace543be tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:58.932256 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-66a2c857-746a-4cde-8fb3-7185ace543be tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:58.933020 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-66a2c857-746a-4cde-8fb3-7185ace543be tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:58.933454 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-66a2c857-746a-4cde-8fb3-7185ace543be tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:59.061382 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-66a2c857-746a-4cde-8fb3-7185ace543be tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:36:59.068900 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-66a2c857-746a-4cde-8fb3-7185ace543be tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6" status: 200 len: 1508 microversion: 2.1 time: 0.148717 Jul 31 14:36:59.069479 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 522/1072] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:36:58 2022] GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:36:59.089870 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c7d025fd-b37a-4cd1-b8db-838f0b75041e tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4608f9b1-affd-47b6-a643-7f3de2c73d6c", "device": "/dev/sdb"}} {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:36:59.092734 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c7d025fd-b37a-4cd1-b8db-838f0b75041e tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: ad3cfed9-01ad-4da4-9459-d1c9141129d6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:36:59.099712 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c7d025fd-b37a-4cd1-b8db-838f0b75041e tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:59.100157 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c7d025fd-b37a-4cd1-b8db-838f0b75041e tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:59.100907 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c7d025fd-b37a-4cd1-b8db-838f0b75041e tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:36:59.101336 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c7d025fd-b37a-4cd1-b8db-838f0b75041e tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:36:59.342766 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c7d025fd-b37a-4cd1-b8db-838f0b75041e tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "POST /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256659 Jul 31 14:36:59.343601 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 551/1073] 10.222.0.40 () {60 vars in 1323 bytes} [Sun Jul 31 14:36:59 2022] POST /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:37:18.691847 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-b5c2b850-9900-45a4-ba6c-17d9e58ac999 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:37:18.692344 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-b5c2b850-9900-45a4-ba6c-17d9e58ac999 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: ad3cfed9-01ad-4da4-9459-d1c9141129d6] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:37:18.694289 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=2 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:37:18.694967 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell0:SELECT=6 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:37:18.695642 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:37:18.696250 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:37:18.702775 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b5c2b850-9900-45a4-ba6c-17d9e58ac999 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:18.703223 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b5c2b850-9900-45a4-ba6c-17d9e58ac999 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:18.704294 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b5c2b850-9900-45a4-ba6c-17d9e58ac999 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:18.704726 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-b5c2b850-9900-45a4-ba6c-17d9e58ac999 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:18.788639 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.objects.instance [None req-b5c2b850-9900-45a4-ba6c-17d9e58ac999 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lazy-loading 'services' on Instance uuid ad3cfed9-01ad-4da4-9459-d1c9141129d6 {{(pid=117781) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:37:18.858425 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-b5c2b850-9900-45a4-ba6c-17d9e58ac999 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6/os-volume_attachments/4608f9b1-affd-47b6-a643-7f3de2c73d6c" status: 202 len: 0 microversion: 2.1 time: 0.171157 Jul 31 14:37:18.859035 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 523/1074] 10.222.0.40 () {58 vars in 1416 bytes} [Sun Jul 31 14:37:18 2022] DELETE /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6/os-volume_attachments/4608f9b1-affd-47b6-a643-7f3de2c73d6c => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 31 14:37:19.980885 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-f3b2982a-f26c-429c-aaa3-4fb97907d7c1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:37:19.981475 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f3b2982a-f26c-429c-aaa3-4fb97907d7c1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: ad3cfed9-01ad-4da4-9459-d1c9141129d6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:37:19.983921 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell0:SELECT=2 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:37:19.984644 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=24 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:37:19.985387 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:37:19.992215 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f3b2982a-f26c-429c-aaa3-4fb97907d7c1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:19.992667 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f3b2982a-f26c-429c-aaa3-4fb97907d7c1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:19.993463 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f3b2982a-f26c-429c-aaa3-4fb97907d7c1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:19.993900 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-f3b2982a-f26c-429c-aaa3-4fb97907d7c1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:20.020293 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-f3b2982a-f26c-429c-aaa3-4fb97907d7c1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: ad3cfed9-01ad-4da4-9459-d1c9141129d6] Going to try to terminate instance {{(pid=117780) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 14:37:20.092618 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-f3b2982a-f26c-429c-aaa3-4fb97907d7c1 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6" status: 204 len: 0 microversion: 2.1 time: 0.115697 Jul 31 14:37:20.093407 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 552/1075] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:37:19 2022] DELETE /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 14:37:20.103242 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-8f8a1efd-8696-46bd-8414-232917f5f450 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:37:20.103972 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-8f8a1efd-8696-46bd-8414-232917f5f450 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: ad3cfed9-01ad-4da4-9459-d1c9141129d6] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:37:20.110185 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8f8a1efd-8696-46bd-8414-232917f5f450 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:20.111130 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8f8a1efd-8696-46bd-8414-232917f5f450 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:20.111947 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8f8a1efd-8696-46bd-8414-232917f5f450 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:20.112389 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-8f8a1efd-8696-46bd-8414-232917f5f450 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:20.243139 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-8f8a1efd-8696-46bd-8414-232917f5f450 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:37:20.250641 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-8f8a1efd-8696-46bd-8414-232917f5f450 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6" status: 200 len: 1514 microversion: 2.1 time: 0.152251 Jul 31 14:37:20.251870 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 524/1076] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:37:20 2022] GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:37:21.274104 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b8e4d07e-45fd-480d-8402-e4f70d174042 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:37:21.274802 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b8e4d07e-45fd-480d-8402-e4f70d174042 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: ad3cfed9-01ad-4da4-9459-d1c9141129d6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:37:21.281476 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b8e4d07e-45fd-480d-8402-e4f70d174042 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:21.281925 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b8e4d07e-45fd-480d-8402-e4f70d174042 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:21.282699 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b8e4d07e-45fd-480d-8402-e4f70d174042 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:21.283135 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b8e4d07e-45fd-480d-8402-e4f70d174042 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:21.411158 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-b8e4d07e-45fd-480d-8402-e4f70d174042 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:37:21.418681 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b8e4d07e-45fd-480d-8402-e4f70d174042 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6" status: 200 len: 1514 microversion: 2.1 time: 0.148761 Jul 31 14:37:21.419250 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 553/1077] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:37:21 2022] GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 31 14:37:22.317223 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-0500681f-0b11-41c6-86cf-dc26218a0e02 req-5b64b669-13be-441c-bdba-322b7ad77412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3cfed9-01ad-4da4-9459-d1c9141129d6", "name": "network-vif-deleted", "tag": "a764a1ca-cb58-4ec8-b2c3-0b13cedacdfd"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:37:22.327874 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-0500681f-0b11-41c6-86cf-dc26218a0e02 req-5b64b669-13be-441c-bdba-322b7ad77412 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:22.328315 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-0500681f-0b11-41c6-86cf-dc26218a0e02 req-5b64b669-13be-441c-bdba-322b7ad77412 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:22.340155 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-0500681f-0b11-41c6-86cf-dc26218a0e02 req-5b64b669-13be-441c-bdba-322b7ad77412 service nova] Creating event network-vif-deleted:a764a1ca-cb58-4ec8-b2c3-0b13cedacdfd for instance ad3cfed9-01ad-4da4-9459-d1c9141129d6 on hv-cinder-84984 Jul 31 14:37:22.345998 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-0500681f-0b11-41c6-86cf-dc26218a0e02 req-5b64b669-13be-441c-bdba-322b7ad77412 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031734 Jul 31 14:37:22.346781 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 525/1078] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:37:22.448462 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-9021e2e5-b313-47a1-9ada-8eaf3f0838d5 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:37:22.449001 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-9021e2e5-b313-47a1-9ada-8eaf3f0838d5 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: ad3cfed9-01ad-4da4-9459-d1c9141129d6] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:37:22.456200 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9021e2e5-b313-47a1-9ada-8eaf3f0838d5 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:22.456650 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9021e2e5-b313-47a1-9ada-8eaf3f0838d5 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:22.457408 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9021e2e5-b313-47a1-9ada-8eaf3f0838d5 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:22.457851 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9021e2e5-b313-47a1-9ada-8eaf3f0838d5 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:22.489038 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9021e2e5-b313-47a1-9ada-8eaf3f0838d5 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:22.489484 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-9021e2e5-b313-47a1-9ada-8eaf3f0838d5 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:22.489937 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.objects.instance [None req-9021e2e5-b313-47a1-9ada-8eaf3f0838d5 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lazy-loading 'fault' on Instance uuid ad3cfed9-01ad-4da4-9459-d1c9141129d6 {{(pid=117780) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 31 14:37:22.529858 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-9021e2e5-b313-47a1-9ada-8eaf3f0838d5 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d7c887fc7b4987ad0bb94a5a99de5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0c2e10be46218a8cb78b8ca9b62c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:37:22.537731 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-9021e2e5-b313-47a1-9ada-8eaf3f0838d5 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6" status: 200 len: 1308 microversion: 2.1 time: 0.093337 Jul 31 14:37:22.538301 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 554/1079] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:37:22 2022] GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6 => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:37:23.560234 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-73770158-28a9-4f61-9cab-6516ce532973 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:37:23.560848 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-73770158-28a9-4f61-9cab-6516ce532973 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] [instance: ad3cfed9-01ad-4da4-9459-d1c9141129d6] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:37:23.567248 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-73770158-28a9-4f61-9cab-6516ce532973 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:23.567727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-73770158-28a9-4f61-9cab-6516ce532973 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:23.568495 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-73770158-28a9-4f61-9cab-6516ce532973 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:23.569055 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-73770158-28a9-4f61-9cab-6516ce532973 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:23.582404 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.wsgi [None req-73770158-28a9-4f61-9cab-6516ce532973 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] HTTP exception thrown: Instance ad3cfed9-01ad-4da4-9459-d1c9141129d6 could not be found. Jul 31 14:37:23.584025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-73770158-28a9-4f61-9cab-6516ce532973 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Request method failure captured: Jul 31 14:37:23.584025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: request: GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6 HTTP/1.1 Jul 31 14:37:23.584025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept: application/json Jul 31 14:37:23.584025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept-Encoding: identity Jul 31 14:37:23.584025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Connection: close Jul 31 14:37:23.584025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Length: 0 Jul 31 14:37:23.584025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Type: application/json Jul 31 14:37:23.584025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Host: 10.222.0.40 Jul 31 14:37:23.584025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Openstack-System-Scope: None Jul 31 14:37:23.584025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: User-Agent: python-urllib3/1.26.10 Jul 31 14:37:23.584025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Auth-Token: gAAAAABi5pNAwLwMO4MtQvf8jcA493s0OeivdZ88df9sbGcFhiV9VYsYdJ2ZxidB-q7TZPg8JZ1uNrgdF5yvrlp9I-FXgEqUJJIvf5EOUCWdBzJN5zua7AQNeZeSed9I7UOGVwN_Fum-k-RIW_TGNpaRNQA7Dvlxnw_me6NOrKKcKNHxWRWHhYc Jul 31 14:37:23.584025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Id: None Jul 31 14:37:23.584025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Name: None Jul 31 14:37:23.584025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Identity-Status: Confirmed Jul 31 14:37:23.584025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Is-Admin-Project: True Jul 31 14:37:23.584025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Id: default Jul 31 14:37:23.584025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Name: Default Jul 31 14:37:23.584025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Id: 641f0c2e10be46218a8cb78b8ca9b62c Jul 31 14:37:23.584025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1387793288 Jul 31 14:37:23.584025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Role: reader,member Jul 31 14:37:23.584025 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Roles: reader,member Jul 31 14:37:23.585726 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/641f0c2e10be46218a8cb78b8ca9b62c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_641f0c2e10be46218a8cb78b8ca9b62c", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/641f0c2e10be46218a8cb78b8ca9b62c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/641f0c2e10be46218a8cb78b8ca9b62c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:37:23.585726 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant: tempest-VolumesSnapshotTestJSON-1387793288 Jul 31 14:37:23.585726 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Id: 641f0c2e10be46218a8cb78b8ca9b62c Jul 31 14:37:23.585726 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1387793288 Jul 31 14:37:23.585726 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User: tempest-VolumesSnapshotTestJSON-1387793288-project Jul 31 14:37:23.585726 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Id: default Jul 31 14:37:23.585726 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Name: Default Jul 31 14:37:23.585726 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Id: e0d7c887fc7b4987ad0bb94a5a99de5c Jul 31 14:37:23.585726 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Name: tempest-VolumesSnapshotTestJSON-1387793288-project Jul 31 14:37:23.585726 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: method: > Jul 31 14:37:23.585726 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: exception: Instance ad3cfed9-01ad-4da4-9459-d1c9141129d6 could not be found. Jul 31 14:37:23.585726 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: action_args: {'id': 'ad3cfed9-01ad-4da4-9459-d1c9141129d6'} Jul 31 14:37:23.586873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:37:23.586873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:37:23.586873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:37:23.586873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:37:23.586873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:37:23.586873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:37:23.586873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:37:23.586873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:37:23.586873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:37:23.586873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:37:23.586873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad3cfed9-01ad-4da4-9459-d1c9141129d6 could not be found. Jul 31 14:37:23.586873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:37:23.586873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:37:23.586873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:37:23.586873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:37:23.586873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:37:23.586873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:37:23.586873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:37:23.586873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:37:23.586873 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:37:23.588689 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:37:23.588689 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:37:23.588689 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:37:23.588689 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:37:23.588689 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:37:23.588689 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:37:23.588689 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:37:23.588689 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad3cfed9-01ad-4da4-9459-d1c9141129d6 could not be found. Jul 31 14:37:23.588689 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:37:23.588689 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:37:23.588689 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:37:23.588689 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:37:23.588689 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:37:23.588689 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:37:23.588689 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:37:23.588689 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:37:23.588689 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad3cfed9-01ad-4da4-9459-d1c9141129d6 could not be found. Jul 31 14:37:23.588689 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:37:23.590175 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-73770158-28a9-4f61-9cab-6516ce532973 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] Returning 404 to user: Instance ad3cfed9-01ad-4da4-9459-d1c9141129d6 could not be found. {{(pid=117781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:37:23.590175 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-73770158-28a9-4f61-9cab-6516ce532973 tempest-VolumesSnapshotTestJSON-1387793288 tempest-VolumesSnapshotTestJSON-1387793288-project] 10.222.0.40 "GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6" status: 404 len: 111 microversion: 2.1 time: 0.029968 Jul 31 14:37:23.590175 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 526/1080] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:37:23 2022] GET /compute/v2.1/servers/ad3cfed9-01ad-4da4-9459-d1c9141129d6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:37:46.252952 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-b106884c-f244-4619-b73d-143fcdeb991e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:37:46.253505 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b106884c-f244-4619-b73d-143fcdeb991e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 13d860ea-649d-450e-9109-a894846adb15] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:37:46.255527 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-ea540cd2-afe0-4e4c-8f94-df231d8c0e2d req-c9da4823-9090-41b7-881e-014546e2e529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13d860ea-649d-450e-9109-a894846adb15", "tag": "95d89b44-b2c4-45a0-92d6-216979da73e6"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:37:46.259200 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:37:46.260011 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG dbcounter [-] [117780] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117780) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:37:46.261361 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_api:SELECT=8 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:37:46.261917 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b106884c-f244-4619-b73d-143fcdeb991e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:46.262137 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG dbcounter [-] [117781] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117781) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 31 14:37:46.262772 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b106884c-f244-4619-b73d-143fcdeb991e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:46.263688 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b106884c-f244-4619-b73d-143fcdeb991e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:46.264412 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-b106884c-f244-4619-b73d-143fcdeb991e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:46.270698 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-ea540cd2-afe0-4e4c-8f94-df231d8c0e2d req-c9da4823-9090-41b7-881e-014546e2e529 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:46.271273 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-ea540cd2-afe0-4e4c-8f94-df231d8c0e2d req-c9da4823-9090-41b7-881e-014546e2e529 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:46.284619 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-ea540cd2-afe0-4e4c-8f94-df231d8c0e2d req-c9da4823-9090-41b7-881e-014546e2e529 service nova] Creating event network-changed:95d89b44-b2c4-45a0-92d6-216979da73e6 for instance 13d860ea-649d-450e-9109-a894846adb15 on hv-cinder-84984 Jul 31 14:37:46.289853 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-ea540cd2-afe0-4e4c-8f94-df231d8c0e2d req-c9da4823-9090-41b7-881e-014546e2e529 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039198 Jul 31 14:37:46.291083 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 527/1081] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:37:46.295327 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-b106884c-f244-4619-b73d-143fcdeb991e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 13d860ea-649d-450e-9109-a894846adb15] Going to try to terminate instance {{(pid=117780) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 14:37:46.383446 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-b106884c-f244-4619-b73d-143fcdeb991e tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "DELETE /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15" status: 204 len: 0 microversion: 2.1 time: 0.134764 Jul 31 14:37:46.384274 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 555/1082] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:37:46 2022] DELETE /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 14:37:46.393659 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-6440e484-c58e-4dfc-bc1c-aea59a73bc97 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:37:46.394682 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-6440e484-c58e-4dfc-bc1c-aea59a73bc97 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 13d860ea-649d-450e-9109-a894846adb15] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:37:46.401172 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6440e484-c58e-4dfc-bc1c-aea59a73bc97 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:46.401701 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6440e484-c58e-4dfc-bc1c-aea59a73bc97 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:46.402552 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6440e484-c58e-4dfc-bc1c-aea59a73bc97 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:46.403086 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-6440e484-c58e-4dfc-bc1c-aea59a73bc97 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:46.566129 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-6440e484-c58e-4dfc-bc1c-aea59a73bc97 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:37:46.573751 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-6440e484-c58e-4dfc-bc1c-aea59a73bc97 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15" status: 200 len: 1579 microversion: 2.1 time: 0.184427 Jul 31 14:37:46.574324 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 528/1083] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:37:46 2022] GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15 => generated 1579 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:37:47.596781 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-2d9b1418-53da-49e1-967c-221bd04a1637 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:37:47.597398 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-2d9b1418-53da-49e1-967c-221bd04a1637 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 13d860ea-649d-450e-9109-a894846adb15] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:37:47.603755 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2d9b1418-53da-49e1-967c-221bd04a1637 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:47.604201 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2d9b1418-53da-49e1-967c-221bd04a1637 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:47.604968 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2d9b1418-53da-49e1-967c-221bd04a1637 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:47.605449 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-2d9b1418-53da-49e1-967c-221bd04a1637 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:47.762506 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-2d9b1418-53da-49e1-967c-221bd04a1637 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:37:47.770175 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-2d9b1418-53da-49e1-967c-221bd04a1637 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15" status: 200 len: 1579 microversion: 2.1 time: 0.178309 Jul 31 14:37:47.771062 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 556/1084] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:37:47 2022] GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15 => generated 1579 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:37:48.486857 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-70fc6b45-4e48-4961-945c-5fa63b1620b5 req-3b47bf3e-1e65-42fd-8311-77d4b6bdeac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13d860ea-649d-450e-9109-a894846adb15", "name": "network-vif-deleted", "tag": "95d89b44-b2c4-45a0-92d6-216979da73e6"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:37:48.497367 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-70fc6b45-4e48-4961-945c-5fa63b1620b5 req-3b47bf3e-1e65-42fd-8311-77d4b6bdeac9 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:48.497911 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-70fc6b45-4e48-4961-945c-5fa63b1620b5 req-3b47bf3e-1e65-42fd-8311-77d4b6bdeac9 service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:48.510625 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-70fc6b45-4e48-4961-945c-5fa63b1620b5 req-3b47bf3e-1e65-42fd-8311-77d4b6bdeac9 service nova] Creating event network-vif-deleted:95d89b44-b2c4-45a0-92d6-216979da73e6 for instance 13d860ea-649d-450e-9109-a894846adb15 on hv-cinder-84984 Jul 31 14:37:48.515589 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-70fc6b45-4e48-4961-945c-5fa63b1620b5 req-3b47bf3e-1e65-42fd-8311-77d4b6bdeac9 service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032465 Jul 31 14:37:48.516205 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 529/1085] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:37:48.791792 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c56b17eb-0cc5-4ccc-a28e-dbe36f2130d6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:37:48.792406 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c56b17eb-0cc5-4ccc-a28e-dbe36f2130d6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 13d860ea-649d-450e-9109-a894846adb15] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:37:48.800108 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c56b17eb-0cc5-4ccc-a28e-dbe36f2130d6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:48.800798 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c56b17eb-0cc5-4ccc-a28e-dbe36f2130d6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:48.801573 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c56b17eb-0cc5-4ccc-a28e-dbe36f2130d6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:48.802010 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c56b17eb-0cc5-4ccc-a28e-dbe36f2130d6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:48.871923 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c56b17eb-0cc5-4ccc-a28e-dbe36f2130d6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:37:48.880282 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c56b17eb-0cc5-4ccc-a28e-dbe36f2130d6 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15" status: 200 len: 1226 microversion: 2.1 time: 0.092429 Jul 31 14:37:48.887605 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 557/1086] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:37:48 2022] GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:37:49.902875 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-020bd3ad-c19f-473a-b612-ae90d0e66967 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:37:49.903672 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-020bd3ad-c19f-473a-b612-ae90d0e66967 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 13d860ea-649d-450e-9109-a894846adb15] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:37:49.910404 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-020bd3ad-c19f-473a-b612-ae90d0e66967 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:49.910853 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-020bd3ad-c19f-473a-b612-ae90d0e66967 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:49.911651 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-020bd3ad-c19f-473a-b612-ae90d0e66967 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:49.912098 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-020bd3ad-c19f-473a-b612-ae90d0e66967 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:49.925706 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.wsgi [None req-020bd3ad-c19f-473a-b612-ae90d0e66967 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] HTTP exception thrown: Instance 13d860ea-649d-450e-9109-a894846adb15 could not be found. Jul 31 14:37:49.927337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-020bd3ad-c19f-473a-b612-ae90d0e66967 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Request method failure captured: Jul 31 14:37:49.927337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: request: GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15 HTTP/1.1 Jul 31 14:37:49.927337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept: application/json Jul 31 14:37:49.927337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept-Encoding: identity Jul 31 14:37:49.927337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Connection: close Jul 31 14:37:49.927337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Length: 0 Jul 31 14:37:49.927337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Type: application/json Jul 31 14:37:49.927337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Host: 10.222.0.40 Jul 31 14:37:49.927337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Openstack-System-Scope: None Jul 31 14:37:49.927337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: User-Agent: python-urllib3/1.26.10 Jul 31 14:37:49.927337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Auth-Token: gAAAAABi5pIuPU2jZpZf2xDz2TAPb6FX5LrwVhaqR1PsgzjEvsOJhbDC_23vsYwLOo5bPGFkfflN5J9J67K3925nUzp7RSIVvRlzDYhKPbFFP1Mx6Jv6M1Qjc1_prKYtBwjkdnNszLppFt1xa9wjzPs0Grz4Lk61dmK0vjI0Oo-6OCPiKvN_Lrk Jul 31 14:37:49.927337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Id: None Jul 31 14:37:49.927337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Name: None Jul 31 14:37:49.927337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Identity-Status: Confirmed Jul 31 14:37:49.927337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Is-Admin-Project: True Jul 31 14:37:49.927337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Id: default Jul 31 14:37:49.927337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Name: Default Jul 31 14:37:49.927337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Id: 8561e7f1f3d040e28d5084ebf937e198 Jul 31 14:37:49.927337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Name: tempest-TestVolumeBootPattern-777606254 Jul 31 14:37:49.927337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Role: reader,member Jul 31 14:37:49.927337 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Roles: reader,member Jul 31 14:37:49.929053 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8561e7f1f3d040e28d5084ebf937e198"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8561e7f1f3d040e28d5084ebf937e198", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8561e7f1f3d040e28d5084ebf937e198"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8561e7f1f3d040e28d5084ebf937e198"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:37:49.929053 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant: tempest-TestVolumeBootPattern-777606254 Jul 31 14:37:49.929053 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Id: 8561e7f1f3d040e28d5084ebf937e198 Jul 31 14:37:49.929053 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Name: tempest-TestVolumeBootPattern-777606254 Jul 31 14:37:49.929053 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User: tempest-TestVolumeBootPattern-777606254-project Jul 31 14:37:49.929053 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Id: default Jul 31 14:37:49.929053 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Name: Default Jul 31 14:37:49.929053 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Id: 0bbe35ad557841c581e3b1a4aa272f38 Jul 31 14:37:49.929053 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Name: tempest-TestVolumeBootPattern-777606254-project Jul 31 14:37:49.929053 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: method: > Jul 31 14:37:49.929053 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: exception: Instance 13d860ea-649d-450e-9109-a894846adb15 could not be found. Jul 31 14:37:49.929053 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: action_args: {'id': '13d860ea-649d-450e-9109-a894846adb15'} Jul 31 14:37:49.930116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:37:49.930116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:37:49.930116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:37:49.930116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:37:49.930116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:37:49.930116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:37:49.930116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:37:49.930116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:37:49.930116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:37:49.930116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:37:49.930116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13d860ea-649d-450e-9109-a894846adb15 could not be found. Jul 31 14:37:49.930116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:37:49.930116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:37:49.930116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:37:49.930116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:37:49.930116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:37:49.930116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:37:49.930116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:37:49.930116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:37:49.930116 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:37:49.931727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:37:49.931727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:37:49.931727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:37:49.931727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:37:49.931727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:37:49.931727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:37:49.931727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:37:49.931727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13d860ea-649d-450e-9109-a894846adb15 could not be found. Jul 31 14:37:49.931727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:37:49.931727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:37:49.931727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:37:49.931727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:37:49.931727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:37:49.931727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:37:49.931727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:37:49.931727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:37:49.931727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13d860ea-649d-450e-9109-a894846adb15 could not be found. Jul 31 14:37:49.931727 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:37:49.933070 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-020bd3ad-c19f-473a-b612-ae90d0e66967 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Returning 404 to user: Instance 13d860ea-649d-450e-9109-a894846adb15 could not be found. {{(pid=117781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:37:49.933070 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-020bd3ad-c19f-473a-b612-ae90d0e66967 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15" status: 404 len: 111 microversion: 2.1 time: 0.030542 Jul 31 14:37:49.933070 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 530/1087] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:37:49 2022] GET /compute/v2.1/servers/13d860ea-649d-450e-9109-a894846adb15 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 14:37:52.985213 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-03836218-3063-4366-b932-d0fc5ebff90a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:37:52.985768 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-03836218-3063-4366-b932-d0fc5ebff90a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: ea499741-0bd8-4766-b692-1894c085cfc9] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:37:52.992164 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-23ac4b6c-470b-4238-98b4-50c223c108b2 req-9e2a923d-b18f-44a9-9e3d-80366254df7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea499741-0bd8-4766-b692-1894c085cfc9", "tag": "4c14b0bd-17df-4ab8-a404-fedf7ab7cc23"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:37:53.002996 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-03836218-3063-4366-b932-d0fc5ebff90a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:53.003807 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-03836218-3063-4366-b932-d0fc5ebff90a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:53.003940 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-23ac4b6c-470b-4238-98b4-50c223c108b2 req-9e2a923d-b18f-44a9-9e3d-80366254df7c service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:53.004215 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-03836218-3063-4366-b932-d0fc5ebff90a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:53.004408 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-23ac4b6c-470b-4238-98b4-50c223c108b2 req-9e2a923d-b18f-44a9-9e3d-80366254df7c service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:53.004643 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-03836218-3063-4366-b932-d0fc5ebff90a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:53.016050 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-23ac4b6c-470b-4238-98b4-50c223c108b2 req-9e2a923d-b18f-44a9-9e3d-80366254df7c service nova] Creating event network-changed:4c14b0bd-17df-4ab8-a404-fedf7ab7cc23 for instance ea499741-0bd8-4766-b692-1894c085cfc9 on hv-cinder-84984 Jul 31 14:37:53.022695 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-23ac4b6c-470b-4238-98b4-50c223c108b2 req-9e2a923d-b18f-44a9-9e3d-80366254df7c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033877 Jul 31 14:37:53.023396 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 531/1088] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:37:53.031708 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-03836218-3063-4366-b932-d0fc5ebff90a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: ea499741-0bd8-4766-b692-1894c085cfc9] Going to try to terminate instance {{(pid=117780) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 31 14:37:53.118912 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-03836218-3063-4366-b932-d0fc5ebff90a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "DELETE /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9" status: 204 len: 0 microversion: 2.1 time: 0.137176 Jul 31 14:37:53.119736 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 558/1089] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:37:52 2022] DELETE /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 31 14:37:53.132703 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-c09e5ce0-47de-4e43-bc40-cb3dad406f67 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:37:53.133575 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-c09e5ce0-47de-4e43-bc40-cb3dad406f67 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: ea499741-0bd8-4766-b692-1894c085cfc9] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:37:53.144820 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c09e5ce0-47de-4e43-bc40-cb3dad406f67 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:53.145607 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c09e5ce0-47de-4e43-bc40-cb3dad406f67 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:53.147389 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c09e5ce0-47de-4e43-bc40-cb3dad406f67 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:53.147864 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-c09e5ce0-47de-4e43-bc40-cb3dad406f67 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:53.754402 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.policy [None req-c09e5ce0-47de-4e43-bc40-cb3dad406f67 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117781) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:37:53.762467 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-c09e5ce0-47de-4e43-bc40-cb3dad406f67 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9" status: 200 len: 1580 microversion: 2.1 time: 0.634184 Jul 31 14:37:53.763118 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 532/1090] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:37:53 2022] GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9 => generated 1580 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:37:54.785061 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-c424cc67-46a7-436e-941a-5c5ebe99bb66 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:37:54.785683 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-c424cc67-46a7-436e-941a-5c5ebe99bb66 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: ea499741-0bd8-4766-b692-1894c085cfc9] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:37:54.792412 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c424cc67-46a7-436e-941a-5c5ebe99bb66 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:54.792865 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c424cc67-46a7-436e-941a-5c5ebe99bb66 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:54.793643 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c424cc67-46a7-436e-941a-5c5ebe99bb66 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:54.794082 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-c424cc67-46a7-436e-941a-5c5ebe99bb66 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:54.981302 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.policy [None req-c424cc67-46a7-436e-941a-5c5ebe99bb66 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bbe35ad557841c581e3b1a4aa272f38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8561e7f1f3d040e28d5084ebf937e198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117780) authorize /opt/stack/nova/nova/policy.py:199}} Jul 31 14:37:54.989435 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-c424cc67-46a7-436e-941a-5c5ebe99bb66 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9" status: 200 len: 1461 microversion: 2.1 time: 0.209255 Jul 31 14:37:54.990020 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 559/1091] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:37:54 2022] GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9 => generated 1461 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 31 14:37:55.207816 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [req-c9c871ff-24e2-4358-84c9-0a8dff1841fc req-c0a93177-4e21-4114-83e8-e0b7cc66540c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea499741-0bd8-4766-b692-1894c085cfc9", "name": "network-vif-deleted", "tag": "4c14b0bd-17df-4ab8-a404-fedf7ab7cc23"}]} {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 31 14:37:55.218890 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-c9c871ff-24e2-4358-84c9-0a8dff1841fc req-c0a93177-4e21-4114-83e8-e0b7cc66540c service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:55.219326 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [req-c9c871ff-24e2-4358-84c9-0a8dff1841fc req-c0a93177-4e21-4114-83e8-e0b7cc66540c service nova] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:55.231678 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.compute.server_external_events [req-c9c871ff-24e2-4358-84c9-0a8dff1841fc req-c0a93177-4e21-4114-83e8-e0b7cc66540c service nova] Creating event network-vif-deleted:4c14b0bd-17df-4ab8-a404-fedf7ab7cc23 for instance ea499741-0bd8-4766-b692-1894c085cfc9 on hv-cinder-84984 Jul 31 14:37:55.236507 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [req-c9c871ff-24e2-4358-84c9-0a8dff1841fc req-c0a93177-4e21-4114-83e8-e0b7cc66540c service nova] 10.222.0.40 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033161 Jul 31 14:37:55.239589 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 533/1092] 10.222.0.40 () {64 vars in 1317 bytes} [Sun Jul 31 14:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 31 14:37:56.010744 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-047cf946-08b1-4022-ad4b-5eafe5ef29e8 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:37:56.011354 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-047cf946-08b1-4022-ad4b-5eafe5ef29e8 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: ea499741-0bd8-4766-b692-1894c085cfc9] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:37:56.017940 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-047cf946-08b1-4022-ad4b-5eafe5ef29e8 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:56.018387 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-047cf946-08b1-4022-ad4b-5eafe5ef29e8 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:56.019149 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-047cf946-08b1-4022-ad4b-5eafe5ef29e8 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:56.019620 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-047cf946-08b1-4022-ad4b-5eafe5ef29e8 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:56.032675 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-047cf946-08b1-4022-ad4b-5eafe5ef29e8 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] HTTP exception thrown: Instance ea499741-0bd8-4766-b692-1894c085cfc9 could not be found. Jul 31 14:37:56.034322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-047cf946-08b1-4022-ad4b-5eafe5ef29e8 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Request method failure captured: Jul 31 14:37:56.034322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9 HTTP/1.1 Jul 31 14:37:56.034322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:37:56.034322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:37:56.034322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:37:56.034322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:37:56.034322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:37:56.034322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:37:56.034322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:37:56.034322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:37:56.034322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pIuPU2jZpZf2xDz2TAPb6FX5LrwVhaqR1PsgzjEvsOJhbDC_23vsYwLOo5bPGFkfflN5J9J67K3925nUzp7RSIVvRlzDYhKPbFFP1Mx6Jv6M1Qjc1_prKYtBwjkdnNszLppFt1xa9wjzPs0Grz4Lk61dmK0vjI0Oo-6OCPiKvN_Lrk Jul 31 14:37:56.034322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:37:56.034322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:37:56.034322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:37:56.034322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:37:56.034322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:37:56.034322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:37:56.034322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: 8561e7f1f3d040e28d5084ebf937e198 Jul 31 14:37:56.034322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-TestVolumeBootPattern-777606254 Jul 31 14:37:56.034322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:37:56.034322 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:37:56.036010 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8561e7f1f3d040e28d5084ebf937e198"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8561e7f1f3d040e28d5084ebf937e198", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8561e7f1f3d040e28d5084ebf937e198"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8561e7f1f3d040e28d5084ebf937e198"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:37:56.036010 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-TestVolumeBootPattern-777606254 Jul 31 14:37:56.036010 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 8561e7f1f3d040e28d5084ebf937e198 Jul 31 14:37:56.036010 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-TestVolumeBootPattern-777606254 Jul 31 14:37:56.036010 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-TestVolumeBootPattern-777606254-project Jul 31 14:37:56.036010 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:37:56.036010 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:37:56.036010 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: 0bbe35ad557841c581e3b1a4aa272f38 Jul 31 14:37:56.036010 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-TestVolumeBootPattern-777606254-project Jul 31 14:37:56.036010 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:37:56.036010 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance ea499741-0bd8-4766-b692-1894c085cfc9 could not be found. Jul 31 14:37:56.036010 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': 'ea499741-0bd8-4766-b692-1894c085cfc9'} Jul 31 14:37:56.036980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:37:56.036980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:37:56.036980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:37:56.036980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:37:56.036980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:37:56.036980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:37:56.036980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:37:56.036980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:37:56.036980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:37:56.036980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:37:56.036980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea499741-0bd8-4766-b692-1894c085cfc9 could not be found. Jul 31 14:37:56.036980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:37:56.036980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:37:56.036980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:37:56.036980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:37:56.036980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:37:56.036980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:37:56.036980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:37:56.036980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:37:56.036980 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:37:56.038523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:37:56.038523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:37:56.038523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:37:56.038523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:37:56.038523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:37:56.038523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:37:56.038523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:37:56.038523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea499741-0bd8-4766-b692-1894c085cfc9 could not be found. Jul 31 14:37:56.038523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:37:56.038523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:37:56.038523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:37:56.038523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:37:56.038523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:37:56.038523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:37:56.038523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:37:56.038523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:37:56.038523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea499741-0bd8-4766-b692-1894c085cfc9 could not be found. Jul 31 14:37:56.038523 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:37:56.039949 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-047cf946-08b1-4022-ad4b-5eafe5ef29e8 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Returning 404 to user: Instance ea499741-0bd8-4766-b692-1894c085cfc9 could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:37:56.039949 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-047cf946-08b1-4022-ad4b-5eafe5ef29e8 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9" status: 404 len: 111 microversion: 2.1 time: 0.028854 Jul 31 14:37:56.039949 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 560/1093] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:37:56 2022] GET /compute/v2.1/servers/ea499741-0bd8-4766-b692-1894c085cfc9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 31 14:37:56.470700 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7c01ad5e-e6cf-45e1-bc7a-7a5b2030b928 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:37:56.471285 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.compute.api [None req-7c01ad5e-e6cf-45e1-bc7a-7a5b2030b928 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] Fetching instance by UUID {{(pid=117781) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:37:56.477589 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7c01ad5e-e6cf-45e1-bc7a-7a5b2030b928 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:56.478046 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7c01ad5e-e6cf-45e1-bc7a-7a5b2030b928 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:56.478814 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7c01ad5e-e6cf-45e1-bc7a-7a5b2030b928 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:56.479256 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG oslo_concurrency.lockutils [None req-7c01ad5e-e6cf-45e1-bc7a-7a5b2030b928 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117781) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:56.493145 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.wsgi [None req-7c01ad5e-e6cf-45e1-bc7a-7a5b2030b928 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] HTTP exception thrown: Instance 34675f3a-4930-453a-9c06-142fabaa0dcc could not be found. Jul 31 14:37:56.496169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7c01ad5e-e6cf-45e1-bc7a-7a5b2030b928 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Request method failure captured: Jul 31 14:37:56.496169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: request: DELETE /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc HTTP/1.1 Jul 31 14:37:56.496169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept: application/json Jul 31 14:37:56.496169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Accept-Encoding: identity Jul 31 14:37:56.496169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Connection: close Jul 31 14:37:56.496169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Length: 0 Jul 31 14:37:56.496169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Content-Type: application/json Jul 31 14:37:56.496169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Host: 10.222.0.40 Jul 31 14:37:56.496169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Openstack-System-Scope: None Jul 31 14:37:56.496169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: User-Agent: python-urllib3/1.26.10 Jul 31 14:37:56.496169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Auth-Token: gAAAAABi5pIuPU2jZpZf2xDz2TAPb6FX5LrwVhaqR1PsgzjEvsOJhbDC_23vsYwLOo5bPGFkfflN5J9J67K3925nUzp7RSIVvRlzDYhKPbFFP1Mx6Jv6M1Qjc1_prKYtBwjkdnNszLppFt1xa9wjzPs0Grz4Lk61dmK0vjI0Oo-6OCPiKvN_Lrk Jul 31 14:37:56.496169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Id: None Jul 31 14:37:56.496169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Domain-Name: None Jul 31 14:37:56.496169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Identity-Status: Confirmed Jul 31 14:37:56.496169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Is-Admin-Project: True Jul 31 14:37:56.496169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Id: default Jul 31 14:37:56.496169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Domain-Name: Default Jul 31 14:37:56.496169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Id: 8561e7f1f3d040e28d5084ebf937e198 Jul 31 14:37:56.496169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Project-Name: tempest-TestVolumeBootPattern-777606254 Jul 31 14:37:56.496169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Role: reader,member Jul 31 14:37:56.496169 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Roles: reader,member Jul 31 14:37:56.498568 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8561e7f1f3d040e28d5084ebf937e198"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8561e7f1f3d040e28d5084ebf937e198", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8561e7f1f3d040e28d5084ebf937e198"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8561e7f1f3d040e28d5084ebf937e198"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:37:56.498568 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant: tempest-TestVolumeBootPattern-777606254 Jul 31 14:37:56.498568 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Id: 8561e7f1f3d040e28d5084ebf937e198 Jul 31 14:37:56.498568 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-Tenant-Name: tempest-TestVolumeBootPattern-777606254 Jul 31 14:37:56.498568 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User: tempest-TestVolumeBootPattern-777606254-project Jul 31 14:37:56.498568 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Id: default Jul 31 14:37:56.498568 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Domain-Name: Default Jul 31 14:37:56.498568 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Id: 0bbe35ad557841c581e3b1a4aa272f38 Jul 31 14:37:56.498568 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: X-User-Name: tempest-TestVolumeBootPattern-777606254-project Jul 31 14:37:56.498568 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: method: > Jul 31 14:37:56.498568 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: exception: Instance 34675f3a-4930-453a-9c06-142fabaa0dcc could not be found. Jul 31 14:37:56.498568 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: action_args: {'id': '34675f3a-4930-453a-9c06-142fabaa0dcc'} Jul 31 14:37:56.499393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:37:56.499393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:37:56.499393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:37:56.499393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:37:56.499393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:37:56.499393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:37:56.499393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:37:56.499393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:37:56.499393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:37:56.499393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:37:56.499393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34675f3a-4930-453a-9c06-142fabaa0dcc could not be found. Jul 31 14:37:56.499393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:37:56.499393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:37:56.499393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:37:56.499393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:37:56.499393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:37:56.499393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:37:56.499393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:37:56.499393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:37:56.499393 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:37:56.500704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:37:56.500704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 31 14:37:56.500704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 31 14:37:56.500704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 31 14:37:56.500704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 31 14:37:56.500704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:37:56.500704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:37:56.500704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:37:56.500704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:37:56.500704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34675f3a-4930-453a-9c06-142fabaa0dcc could not be found. Jul 31 14:37:56.500704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:37:56.500704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:37:56.500704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:37:56.500704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:37:56.500704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:37:56.500704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:37:56.500704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:37:56.500704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:37:56.500704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34675f3a-4930-453a-9c06-142fabaa0dcc could not be found. Jul 31 14:37:56.500704 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: ERROR nova.api.openstack.wsgi Jul 31 14:37:56.503889 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-7c01ad5e-e6cf-45e1-bc7a-7a5b2030b928 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Returning 404 to user: Instance 34675f3a-4930-453a-9c06-142fabaa0dcc could not be found. {{(pid=117781) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:37:56.503889 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-7c01ad5e-e6cf-45e1-bc7a-7a5b2030b928 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "DELETE /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc" status: 404 len: 111 microversion: 2.1 time: 0.032061 Jul 31 14:37:56.503889 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 534/1094] 10.222.0.40 () {58 vars in 1239 bytes} [Sun Jul 31 14:37:56 2022] DELETE /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:37:56.511277 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-39d736b0-8fce-4ff9-ab96-9b93cd95f66a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '>' {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:37:56.512277 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.compute.api [None req-39d736b0-8fce-4ff9-ab96-9b93cd95f66a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] [instance: 34675f3a-4930-453a-9c06-142fabaa0dcc] Fetching instance by UUID {{(pid=117780) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 31 14:37:56.518674 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-39d736b0-8fce-4ff9-ab96-9b93cd95f66a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:56.519126 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-39d736b0-8fce-4ff9-ab96-9b93cd95f66a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:56.520524 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-39d736b0-8fce-4ff9-ab96-9b93cd95f66a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 31 14:37:56.520964 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG oslo_concurrency.lockutils [None req-39d736b0-8fce-4ff9-ab96-9b93cd95f66a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Lock "75a43629-b1b3-47e1-9ca8-733d69d3b5de" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 31 14:37:56.534321 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.wsgi [None req-39d736b0-8fce-4ff9-ab96-9b93cd95f66a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] HTTP exception thrown: Instance 34675f3a-4930-453a-9c06-142fabaa0dcc could not be found. Jul 31 14:37:56.535855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-39d736b0-8fce-4ff9-ab96-9b93cd95f66a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Request method failure captured: Jul 31 14:37:56.535855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: request: GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc HTTP/1.1 Jul 31 14:37:56.535855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept: application/json Jul 31 14:37:56.535855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Accept-Encoding: identity Jul 31 14:37:56.535855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Connection: close Jul 31 14:37:56.535855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Length: 0 Jul 31 14:37:56.535855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Content-Type: application/json Jul 31 14:37:56.535855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Host: 10.222.0.40 Jul 31 14:37:56.535855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Openstack-System-Scope: None Jul 31 14:37:56.535855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: User-Agent: python-urllib3/1.26.10 Jul 31 14:37:56.535855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Auth-Token: gAAAAABi5pIuPU2jZpZf2xDz2TAPb6FX5LrwVhaqR1PsgzjEvsOJhbDC_23vsYwLOo5bPGFkfflN5J9J67K3925nUzp7RSIVvRlzDYhKPbFFP1Mx6Jv6M1Qjc1_prKYtBwjkdnNszLppFt1xa9wjzPs0Grz4Lk61dmK0vjI0Oo-6OCPiKvN_Lrk Jul 31 14:37:56.535855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Id: None Jul 31 14:37:56.535855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Domain-Name: None Jul 31 14:37:56.535855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Identity-Status: Confirmed Jul 31 14:37:56.535855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Is-Admin-Project: True Jul 31 14:37:56.535855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Id: default Jul 31 14:37:56.535855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Domain-Name: Default Jul 31 14:37:56.535855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Id: 8561e7f1f3d040e28d5084ebf937e198 Jul 31 14:37:56.535855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Project-Name: tempest-TestVolumeBootPattern-777606254 Jul 31 14:37:56.535855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Role: reader,member Jul 31 14:37:56.535855 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Roles: reader,member Jul 31 14:37:56.537531 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8561e7f1f3d040e28d5084ebf937e198"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:8080/v1/AUTH_8561e7f1f3d040e28d5084ebf937e198", "adminURL": "http://10.222.0.40:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2/8561e7f1f3d040e28d5084ebf937e198"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/volume/v3/8561e7f1f3d040e28d5084ebf937e198"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.40/image"}]}] Jul 31 14:37:56.537531 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant: tempest-TestVolumeBootPattern-777606254 Jul 31 14:37:56.537531 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Id: 8561e7f1f3d040e28d5084ebf937e198 Jul 31 14:37:56.537531 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-Tenant-Name: tempest-TestVolumeBootPattern-777606254 Jul 31 14:37:56.537531 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User: tempest-TestVolumeBootPattern-777606254-project Jul 31 14:37:56.537531 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Id: default Jul 31 14:37:56.537531 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Domain-Name: Default Jul 31 14:37:56.537531 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Id: 0bbe35ad557841c581e3b1a4aa272f38 Jul 31 14:37:56.537531 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: X-User-Name: tempest-TestVolumeBootPattern-777606254-project Jul 31 14:37:56.537531 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: method: > Jul 31 14:37:56.537531 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: exception: Instance 34675f3a-4930-453a-9c06-142fabaa0dcc could not be found. Jul 31 14:37:56.537531 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: action_args: {'id': '34675f3a-4930-453a-9c06-142fabaa0dcc'} Jul 31 14:37:56.538530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: {{(pid=117780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 31 14:37:56.538530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:37:56.538530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 31 14:37:56.538530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 31 14:37:56.538530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 31 14:37:56.538530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 31 14:37:56.538530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 31 14:37:56.538530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 31 14:37:56.538530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 31 14:37:56.538530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 31 14:37:56.538530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34675f3a-4930-453a-9c06-142fabaa0dcc could not be found. Jul 31 14:37:56.538530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:37:56.538530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:37:56.538530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:37:56.538530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:37:56.538530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:37:56.538530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:37:56.538530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 31 14:37:56.538530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 31 14:37:56.538530 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 31 14:37:56.539834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 31 14:37:56.539834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 31 14:37:56.539834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 31 14:37:56.539834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 31 14:37:56.539834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 31 14:37:56.539834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 31 14:37:56.539834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 31 14:37:56.539834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34675f3a-4930-453a-9c06-142fabaa0dcc could not be found. Jul 31 14:37:56.539834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:37:56.539834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 31 14:37:56.539834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:37:56.539834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 31 14:37:56.539834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 31 14:37:56.539834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 31 14:37:56.539834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 31 14:37:56.539834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 31 14:37:56.539834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34675f3a-4930-453a-9c06-142fabaa0dcc could not be found. Jul 31 14:37:56.539834 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: ERROR nova.api.openstack.wsgi Jul 31 14:37:56.541048 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: DEBUG nova.api.openstack.wsgi [None req-39d736b0-8fce-4ff9-ab96-9b93cd95f66a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Returning 404 to user: Instance 34675f3a-4930-453a-9c06-142fabaa0dcc could not be found. {{(pid=117780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 31 14:37:56.541048 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO nova.api.openstack.requestlog [None req-39d736b0-8fce-4ff9-ab96-9b93cd95f66a tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc" status: 404 len: 111 microversion: 2.1 time: 0.029770 Jul 31 14:37:56.541048 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: [pid: 117780|app: 0|req: 561/1095] 10.222.0.40 () {58 vars in 1236 bytes} [Sun Jul 31 14:37:56 2022] GET /compute/v2.1/servers/34675f3a-4930-453a-9c06-142fabaa0dcc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 31 14:37:57.832033 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: DEBUG nova.api.openstack.wsgi [None req-f526ea66-b16c-4c3f-a7aa-7aeecfa6e931 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] Calling method '.version_select at 0x7f87e9ab94c0>' {{(pid=117781) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 31 14:37:57.850874 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO nova.api.openstack.requestlog [None req-f526ea66-b16c-4c3f-a7aa-7aeecfa6e931 tempest-TestVolumeBootPattern-777606254 tempest-TestVolumeBootPattern-777606254-project] 10.222.0.40 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1450971051" status: 202 len: 0 microversion: 2.1 time: 0.022867 Jul 31 14:37:57.851475 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: [pid: 117781|app: 0|req: 535/1096] 10.222.0.40 () {58 vars in 1263 bytes} [Sun Jul 31 14:37:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1450971051 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 31 14:39:28.340237 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 14:39:28.340747 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Sun Jul 31 14:39:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 14:39:42.387010 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 14:39:42.387720 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Sun Jul 31 14:39:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 14:41:17.671728 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 14:41:17.672205 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Sun Jul 31 14:41:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 14:42:48.348529 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 14:42:48.349210 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Sun Jul 31 14:42:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 14:42:58.496859 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 14:42:58.497345 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Sun Jul 31 14:42:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 14:43:02.395115 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 14:43:02.395664 dv-cinder-849846-4-iscsi devstack@n-api.service[117781]: Sun Jul 31 14:43:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 31 14:43:15.447379 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 31 14:43:15.448012 dv-cinder-849846-4-iscsi devstack@n-api.service[117780]: Sun Jul 31 14:43:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!